Paper Abstract and Keywords |
Presentation |
2016-11-17 14:00
Transportation aspect of infinitely deep denoising autoencoder Sho Sonoda, Noboru Murata (Waseda Univ.) IBISML2016-88 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
The hidden layers of a deep neural network extract feature of the input data. We propose to analyze the feature map of a neural network by regarding it as a transportation map. The transportation map of denoising autoencoders (DAEs) is derived, which can even characterize the infinitely deep architecture. It is revealed that the composition of DAEs and the continuous DAE transport data points to reduce the entropy of the input data. The stacked DAE, which is a product of a complicated heuristics, can be identified as a composition of DAEs from the view point of a transportation map. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
deep learning / infinitely deep neural network / denoising autoencoder / transportation / backward heat equation / / / |
Reference Info. |
IEICE Tech. Rep., vol. 116, no. 300, IBISML2016-88, pp. 297-304, Nov. 2016. |
Paper # |
IBISML2016-88 |
Date of Issue |
2016-11-09 (IBISML) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
IBISML2016-88 |
Conference Information |
Committee |
IBISML |
Conference Date |
2016-11-16 - 2016-11-18 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Kyoto Univ. |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Information-Based Induction Science Workshop (IBIS2016) |
Paper Information |
Registration To |
IBISML |
Conference Code |
2016-11-IBISML |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Transportation aspect of infinitely deep denoising autoencoder |
Sub Title (in English) |
|
Keyword(1) |
deep learning |
Keyword(2) |
infinitely deep neural network |
Keyword(3) |
denoising autoencoder |
Keyword(4) |
transportation |
Keyword(5) |
backward heat equation |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Sho Sonoda |
1st Author's Affiliation |
Waseda University (Waseda Univ.) |
2nd Author's Name |
Noboru Murata |
2nd Author's Affiliation |
Waseda University (Waseda Univ.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2016-11-17 14:00:00 |
Presentation Time |
180 minutes |
Registration for |
IBISML |
Paper # |
IBISML2016-88 |
Volume (vol) |
vol.116 |
Number (no) |
no.300 |
Page |
pp.297-304 |
#Pages |
8 |
Date of Issue |
2016-11-09 (IBISML) |
|