Paper Abstract and Keywords |
Presentation |
2015-10-15 13:25
Statistical singing voice conversion based on direct waveform modification and its parameter generation algorithms Kazuhiro Kobayashi, Tomoki Toda, Satoshi Nakamura (NAIST) SP2015-60 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
This report presents a novel statistical singing voice conversion (SVC) technique with direct waveform modification based on the spectrum differential that can convert voice timbre of a source singer into that of a target singer without vocoder-based waveform generation if F0 conversion is not needed between those speakers. SVC makes it possible to convert voice timbre by statistically modeling the relationship between acoustic features of the source and the target singers. However, speech quality of the converted singing voice is significantly degraded compared to that of a natural singing voice due to some factors, such as errors in excitation modeling based on vocoder and over-smoothing effect of a converted spectral parameter trajectory. To address this issue, we propose a statistical conversion process that estimates the spectral differential between the source and target singers' singing voices and directly modifies the source singer's singing voice waveform by filtering it using the estimated spectral differential without using the vocoder-based waveform generation. Furthermore, we also propose a spectral differential parameter estimation method considering global variance to alleviate the over-smoothing effect. We conduct subjective and objective evaluations, demonstrating that the proposed method makes it possible to significantly improve speech quality while preserving the conversion accuracy of singer identity compared to the conventional SVC. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
singing voice conversion / vocoder / direct waveform modification with spectral differential / global variance / Gaussian mixture model / / / |
Reference Info. |
IEICE Tech. Rep., vol. 115, no. 253, SP2015-60, pp. 7-12, Oct. 2015. |
Paper # |
SP2015-60 |
Date of Issue |
2015-10-08 (SP) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
SP2015-60 |
Conference Information |
Committee |
SP |
Conference Date |
2015-10-15 - 2015-10-16 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Kobe Univ. |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Speech interface, Synthesis, Dialogue, Application system, etc. |
Paper Information |
Registration To |
SP |
Conference Code |
2015-10-SP |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Statistical singing voice conversion based on direct waveform modification and its parameter generation algorithms |
Sub Title (in English) |
|
Keyword(1) |
singing voice conversion |
Keyword(2) |
vocoder |
Keyword(3) |
direct waveform modification with spectral differential |
Keyword(4) |
global variance |
Keyword(5) |
Gaussian mixture model |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Kazuhiro Kobayashi |
1st Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
2nd Author's Name |
Tomoki Toda |
2nd Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
3rd Author's Name |
Satoshi Nakamura |
3rd Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2015-10-15 13:25:00 |
Presentation Time |
25 minutes |
Registration for |
SP |
Paper # |
SP2015-60 |
Volume (vol) |
vol.115 |
Number (no) |
no.253 |
Page |
pp.7-12 |
#Pages |
6 |
Date of Issue |
2015-10-08 (SP) |
|