Paper Abstract and Keywords |
Presentation |
2019-03-05 09:30
Novel Backpropagation Algorithm Considering Energy Rintaro Kanada, Masafumi Hagiwara (Keio Univ.) NC2018-63 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
In this paper, we propose a novel backpropagation(BP) algorithm considering energy. Neural network (NN) can be classified as the feedfoward type and the interconnecting type. In general, the evaluation function in learning is error in the feedfoward type and energy in the interconnecting type. However, the internal state of the network isn't considered in the error. On the other hand, the internal state of the network is considered in the energy. Therefore, we defined the energy so that the internal state of the feedfoward network could be considered. And, we propose an algorithm that uses the difference between the energy for correct answer output and the actual energy in each layer so that the energy becomes lower. In the evaluation experiments, we compared with existing BP using classification tasks. As a result, it is confirmed that convergence of learning is accelerated and there remains possibility of improvement of accuracy and robustness to noise. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
backpropagation / neural network / energy / information amount / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 118, no. 470, NC2018-63, pp. 105-110, March 2019. |
Paper # |
NC2018-63 |
Date of Issue |
2019-02-25 (NC) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
NC2018-63 |
Conference Information |
Committee |
NC MBE |
Conference Date |
2019-03-04 - 2019-03-06 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
University of Electro Communications |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
|
Paper Information |
Registration To |
NC |
Conference Code |
2019-03-NC-MBE |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Novel Backpropagation Algorithm Considering Energy |
Sub Title (in English) |
|
Keyword(1) |
backpropagation |
Keyword(2) |
neural network |
Keyword(3) |
energy |
Keyword(4) |
information amount |
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Rintaro Kanada |
1st Author's Affiliation |
Keio University (Keio Univ.) |
2nd Author's Name |
Masafumi Hagiwara |
2nd Author's Affiliation |
Keio University (Keio Univ.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2019-03-05 09:30:00 |
Presentation Time |
25 minutes |
Registration for |
NC |
Paper # |
NC2018-63 |
Volume (vol) |
vol.118 |
Number (no) |
no.470 |
Page |
pp.105-110 |
#Pages |
6 |
Date of Issue |
2019-02-25 (NC) |
|