Paper Abstract and Keywords |
Presentation |
2009-11-27 10:00
Cross-speaker and cross-language voice conversion based on structural representation of speech Ryusuke Mihara, Daisuke Saito, Nobuaki Minematsu, Keikichi Hirose (Univ. of Tokyo.) SP2009-71 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Speech acoustics easily vary due to non-linguistic factors such as speaker differences and microphone differences. The authors already proposed a structural representation of speech, where these variations can be effectively removed. This representation discards absolute and static properties of speech events and captures only their relative and dynamic features. Recently, a new framework of speech synthesis based on this structural representation has been proposed. Here, an utterance is characterized by two separate attributes, speaker-independent speech form
and speaker-dependent embodiment features found in that utterance. On this framework, a new utterance is generated by realizing a given speech form acoustically and this realization is enabled by providing speaker-dependent embodiment features. This generation process can be viewed as implementation of infants' vocal imitation on a machine. In this report, based on this structural representation, cross-speaker and cross-language voice conversion is implemented. A speaker’s two utterances of Japanese and English are modeled as a single speech form. By providing another speaker’s Japanese utterance of the same content, the English utterance of that speaker will be generated using the speech form. In this report, the performance of the proposed method is evaluated and its problems are also made clear. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
structural representation of speech / speaker-invariance / vocal imitation / language conversion / speaker conversion / / / |
Reference Info. |
IEICE Tech. Rep., vol. 109, no. 308, SP2009-71, pp. 55-60, Nov. 2009. |
Paper # |
SP2009-71 |
Date of Issue |
2009-11-19 (SP) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
SP2009-71 |
Conference Information |
Committee |
SP |
Conference Date |
2009-11-26 - 2009-11-27 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Shizuoka University |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
language acquisition, language learning, speech synthesis, speech production, prosody, etc. |
Paper Information |
Registration To |
SP |
Conference Code |
2009-11-SP |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Cross-speaker and cross-language voice conversion based on structural representation of speech |
Sub Title (in English) |
|
Keyword(1) |
structural representation of speech |
Keyword(2) |
speaker-invariance |
Keyword(3) |
vocal imitation |
Keyword(4) |
language conversion |
Keyword(5) |
speaker conversion |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Ryusuke Mihara |
1st Author's Affiliation |
The University of Tokyo (Univ. of Tokyo.) |
2nd Author's Name |
Daisuke Saito |
2nd Author's Affiliation |
The University of Tokyo (Univ. of Tokyo.) |
3rd Author's Name |
Nobuaki Minematsu |
3rd Author's Affiliation |
The University of Tokyo (Univ. of Tokyo.) |
4th Author's Name |
Keikichi Hirose |
4th Author's Affiliation |
The University of Tokyo (Univ. of Tokyo.) |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2009-11-27 10:00:00 |
Presentation Time |
30 minutes |
Registration for |
SP |
Paper # |
SP2009-71 |
Volume (vol) |
vol.109 |
Number (no) |
no.308 |
Page |
pp.55-60 |
#Pages |
6 |
Date of Issue |
2009-11-19 (SP) |
|