| Paper Abstract and Keywords |
| Presentation |
2024-03-01 09:30
Evaluation of Automatic Speech Recognition for Deaf and Hard-of-Hearing People by Speaker Adaptation. Kaito Takahashi, Takahiro Kinouchi, Yukoh Wakabayashi (TUT), Kengo Ohta (NITAC), Akio Kobayashi (Yamato Univ.), Norihide Kitaoka (TUT) EA2023-102 SIP2023-149 SP2023-84 |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
Communication between normal-hearing people and the deaf is generally used sign language, written communication, and speech recognition.More than half of the deaf are reported to use speech to communicate.Therefore, high-accuracy speech recognition is required for deaf speech.However, speech recognition models trained with normal-hearing speech cannot achieve high accuracy for deaf speech.In addition, we conducted an evaluation experiment of speech recognition by speaker adaptation by fine-tuning with each speaker's speech.As a result, the model that was pre-trained with Japanese normal-hearing speech by self-supervised learning of multilingual speech, fine-tuned with normal-hearing speech, deaf speech, and synthesized speech in succession was the most accurate for deaf speech. Then, by adapting this model to each speaker, we clarified the improvement rate of recognition accuracy and the limit of accuracy improvement. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Speech Recognition / Deaf Speech / Speaker Adaptation / Data Augmentation / / / / |
| Reference Info. |
IEICE Tech. Rep., vol. 123, no. 403, SP2023-84, pp. 244-249, Feb. 2024. |
| Paper # |
SP2023-84 |
| Date of Issue |
2024-02-22 (EA, SIP, SP) |
| ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
| Download PDF |
EA2023-102 SIP2023-149 SP2023-84 |
| Conference Information |
| Committee |
SIP SP EA IPSJ-SLP |
| Conference Date |
2024-02-29 - 2024-03-01 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
|
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
|
| Paper Information |
| Registration To |
SP |
| Conference Code |
2024-02-SIP-SP-EA-SLP |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Evaluation of Automatic Speech Recognition for Deaf and Hard-of-Hearing People by Speaker Adaptation. |
| Sub Title (in English) |
|
| Keyword(1) |
Speech Recognition |
| Keyword(2) |
Deaf Speech |
| Keyword(3) |
Speaker Adaptation |
| Keyword(4) |
Data Augmentation |
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Kaito Takahashi |
| 1st Author's Affiliation |
Toyohashi University of Technology (TUT) |
| 2nd Author's Name |
Takahiro Kinouchi |
| 2nd Author's Affiliation |
Toyohashi University of Technology (TUT) |
| 3rd Author's Name |
Yukoh Wakabayashi |
| 3rd Author's Affiliation |
Toyohashi University of Technology (TUT) |
| 4th Author's Name |
Kengo Ohta |
| 4th Author's Affiliation |
National Institute of Technology, Anan College (NITAC) |
| 5th Author's Name |
Akio Kobayashi |
| 5th Author's Affiliation |
Yamato University (Yamato Univ.) |
| 6th Author's Name |
Norihide Kitaoka |
| 6th Author's Affiliation |
Toyohashi University of Technology (TUT) |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2024-03-01 09:30:00 |
| Presentation Time |
60 minutes |
| Registration for |
SP |
| Paper # |
EA2023-102, SIP2023-149, SP2023-84 |
| Volume (vol) |
vol.123 |
| Number (no) |
no.401(EA), no.402(SIP), no.403(SP) |
| Page |
pp.244-249 |
| #Pages |
6 |
| Date of Issue |
2024-02-22 (EA, SIP, SP) |