| Paper Abstract and Keywords |
| Presentation |
2015-07-16 17:20
Experimental evaluation of network size effect in speaker adaptive trained DNNs embedding linear transformation networks Tsubasa Ochiai (Doshisha Univ./NICT), Shigeki Matsuda (Doshisha Univ.), Hideyuki Watanabe, Xugang Lu, Hisashi Kawai (NICT), Shigeru Katagiri (Doshisha Univ.) SP2015-41 |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
Recently we proposed a novel speaker adaptation method that applied the Speaker Adaptive Training
(SAT) concept to DNN-HMM (SAT-DNN) recognizer and showed its fundamental utility from speaker adaptation
experiments using the TED Talks corpus data. The network employed in our previous experiment consisted of seven
layers: an input layer, five hidden layers, and an output layer. Every hidden layer had 512 nodes, but the validity
of such a network size (512 nodes per layer) was not ensured. Actually, the demonstrated effect of a SAT-DNN
recognizer might have originated from some by-effect of a small network. In addition to this standing question, we
revised SAT-DNN by embedding a Linear Transformation Network (LTN) in a hidden layer of DNN and demonstrated
the superiority over SAT-DNN of this new network called SAT-DNN-LTN. Taking these facts into account,
we investigate in this paper the effectiveness of larger SAT-DNN-LTN recognizers, whose hidden DNN layer has
1024 or 2048 nodes, in the same speaker adaptation experiment framework as in our previous paper. Experiment
results show that larger SAT-DNN-LTN recognizers steadily improve word recognition accuracies and successfully
prove the utility of the recognizer concept of SAT-DNN-LTN. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Speaker Adaptive Training / Deep Neural Network / Linear Transformation Network / Regularized Adaptation / / / / |
| Reference Info. |
IEICE Tech. Rep., vol. 115, no. 146, SP2015-41, pp. 31-36, July 2015. |
| Paper # |
SP2015-41 |
| Date of Issue |
2015-07-09 (SP) |
| ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
| Download PDF |
SP2015-41 |
| Conference Information |
| Committee |
SP IPSJ-SLP |
| Conference Date |
2015-07-16 - 2015-07-17 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Katakura Suwako Hotel |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Speech recognition and understanding, dialog system, etc. |
| Paper Information |
| Registration To |
SP |
| Conference Code |
2015-07-SP-SLP |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Experimental evaluation of network size effect in speaker adaptive trained DNNs embedding linear transformation networks |
| Sub Title (in English) |
|
| Keyword(1) |
Speaker Adaptive Training |
| Keyword(2) |
Deep Neural Network |
| Keyword(3) |
Linear Transformation Network |
| Keyword(4) |
Regularized Adaptation |
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Tsubasa Ochiai |
| 1st Author's Affiliation |
Doshisha University/National Institute of Information and Communications Technology (Doshisha Univ./NICT) |
| 2nd Author's Name |
Shigeki Matsuda |
| 2nd Author's Affiliation |
Doshisha University (Doshisha Univ.) |
| 3rd Author's Name |
Hideyuki Watanabe |
| 3rd Author's Affiliation |
National Institute of Information and Communications Technology (NICT) |
| 4th Author's Name |
Xugang Lu |
| 4th Author's Affiliation |
National Institute of Information and Communications Technology (NICT) |
| 5th Author's Name |
Hisashi Kawai |
| 5th Author's Affiliation |
National Institute of Information and Communications Technology (NICT) |
| 6th Author's Name |
Shigeru Katagiri |
| 6th Author's Affiliation |
Doshisha University (Doshisha Univ.) |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2015-07-16 17:20:00 |
| Presentation Time |
30 minutes |
| Registration for |
SP |
| Paper # |
SP2015-41 |
| Volume (vol) |
vol.115 |
| Number (no) |
no.146 |
| Page |
pp.31-36 |
| #Pages |
6 |
| Date of Issue |
2015-07-09 (SP) |