| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2021-12-03 11:00 Multi-speaker Audiobook Speech Synthesis using Discrete Character Acting Styles Acquired by VQVAE Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Yuki Saito (UT), Yusuke Ijima, Ryo Masumura (NTT), Hiroshi Saruwatari (UT)  NLC2021-26 SP2021-47 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | In this paper, we propose a method of extracting discrete character acting styles using vector quantized variational autoencoder (VQVAE) and multi-speaker audiobook speech synthesis based on extracted character acting styles. In audiobook corpora uttered by voice talents, the speech utterances contain acting depending on the character's attributes. Such acting should also be contained in synthesized audiobooks. However, predicting proper acting style and character attributes is still a hard challenge. To this end, we propose a method for extracting character acting styles from audiobook speech and conditioning TTS models by the extracted character acting styles to synthesize speech with character acting. The subjective evaluation shows that the proposed method achieves a closer character acting style to the ground truth speech. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Audiobook speech synthesis / VQVAE / Character acting styles / / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 121, no. 282, SP2021-47, pp. 42-47, Dec. 2021. | |
| Paper # | SP2021-47 | |
| Date of Issue | 2021-11-24 (NLC, SP) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | NLC2021-26 SP2021-47 |
|
| Conference Information | |
| Committee | NLC IPSJ-NL SP IPSJ-SLP |
| Conference Date | 2021-12-01 - 2021-12-03 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Paper Information | |
| Registration To | SP |
| Conference Code | 2021-12-NLC-NL-SP-SLP |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Multi-speaker Audiobook Speech Synthesis using Discrete Character Acting Styles Acquired by VQVAE |
| Sub Title (in English) | |
| Keyword(1) | Audiobook speech synthesis |
| Keyword(2) | VQVAE |
| Keyword(3) | Character acting styles |
| Keyword(4) | |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Wataru Nakata |
| 1st Author's Affiliation | The University of Tokyo (UT) |
| 2nd Author's Name | Tomoki Koriyama |
| 2nd Author's Affiliation | The University of Tokyo (UT) |
| 3rd Author's Name | Shinnosuke Takamichi |
| 3rd Author's Affiliation | The University of Tokyo (UT) |
| 4th Author's Name | Yuki Saito |
| 4th Author's Affiliation | The University of Tokyo (UT) |
| 5th Author's Name | Yusuke Ijima |
| 5th Author's Affiliation | Nippon Telegraph and Telephone Corporation (NTT) |
| 6th Author's Name | Ryo Masumura |
| 6th Author's Affiliation | Nippon Telegraph and Telephone Corporation (NTT) |
| 7th Author's Name | Hiroshi Saruwatari |
| 7th Author's Affiliation | The University of Tokyo (UT) |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2021-12-03 11:00:00 |
| Presentation Time | 30 minutes |
| Registration for | SP |
| Paper # | NLC2021-26, SP2021-47 |
| Volume (vol) | vol.121 |
| Number (no) | no.281(NLC), no.282(SP) |
| Page | pp.42-47 |
| #Pages | 6 |
| Date of Issue | 2021-11-24 (NLC, SP) |
[Return to Top Page]