| Paper Abstract and Keywords |
| Presentation |
2023-10-14 17:05
Electrolaryngeal Speech Enhancement through Strong Linguistic Encoding Methods Lester Phillip Violeta, Wen-Chin Huang, Ding Ma, Ryuichi Yamamoto, Kazuhiro Kobayashi, Tomoki Toda (Nagoya Univ.) SP2023-33 WIT2023-24 |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
Although pretraining and fine-tuning approaches have proven to work well in speech intelligibility enhancement, various mismatches, such as the speech type mismatch or speaker mismatches between the datasets used in each stage, can deteriorate the conversion performance of this framework. We propose a linguistic encoder robust enough to project both EL and typical speech in the same latent space, while still being able to extract accurate linguistic information, creating a unified representation to reduce the speech type mismatch. Furthermore, we introduce HuBERT output features to the proposed framework for reducing the speaker mismatch. Such a framework makes it possible to effectively use a large-scale parallel dataset during pretraining. We show that compared to the conventional framework using mel-spectrogram input and output features, using the proposed framework enables the model to synthesize more intelligible and naturally sounding speech, as shown by a significant 16% improvement in character error rate and 0.83 improvement in naturalness score. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Intelligibility enhancement / Electrolaryngeal speech / Atypical speech / / / / / |
| Reference Info. |
IEICE Tech. Rep., vol. 123, no. 212, SP2023-33, pp. 33-38, Oct. 2023. |
| Paper # |
SP2023-33 |
| Date of Issue |
2023-10-07 (SP, WIT) |
| ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
| Download PDF |
SP2023-33 WIT2023-24 |
| Conference Information |
| Committee |
WIT SP IPSJ-SLP |
| Conference Date |
2023-10-14 - 2023-10-14 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Kyushu Institute of Technology |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Speech and Well-being Information Technology, etc. |
| Paper Information |
| Registration To |
SP |
| Conference Code |
2023-10-WIT-SP-SLP |
| Language |
English |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Electrolaryngeal Speech Enhancement through Strong Linguistic Encoding Methods |
| Sub Title (in English) |
|
| Keyword(1) |
Intelligibility enhancement |
| Keyword(2) |
Electrolaryngeal speech |
| Keyword(3) |
Atypical speech |
| Keyword(4) |
|
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Lester Phillip Violeta |
| 1st Author's Affiliation |
Nagoya University (Nagoya Univ.) |
| 2nd Author's Name |
Wen-Chin Huang |
| 2nd Author's Affiliation |
Nagoya University (Nagoya Univ.) |
| 3rd Author's Name |
Ding Ma |
| 3rd Author's Affiliation |
Nagoya University (Nagoya Univ.) |
| 4th Author's Name |
Ryuichi Yamamoto |
| 4th Author's Affiliation |
Nagoya University (Nagoya Univ.) |
| 5th Author's Name |
Kazuhiro Kobayashi |
| 5th Author's Affiliation |
Nagoya University (Nagoya Univ.) |
| 6th Author's Name |
Tomoki Toda |
| 6th Author's Affiliation |
Nagoya University (Nagoya Univ.) |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2023-10-14 17:05:00 |
| Presentation Time |
25 minutes |
| Registration for |
SP |
| Paper # |
SP2023-33, WIT2023-24 |
| Volume (vol) |
vol.123 |
| Number (no) |
no.212(SP), no.213(WIT) |
| Page |
pp.33-38 |
| #Pages |
6 |
| Date of Issue |
2023-10-07 (SP, WIT) |