14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Exemplar-Based Unit Selection for Voice Conversion Utilizing Temporal Information

Zhizheng Wu (1), Tuomas Virtanen (2), Tomi Kinnunen (3), Eng Siong Chng (1), Haizhou Li (1)

(1) Nanyang Technological University, Singapore
(2) Tampere University of Technology, Finland
(3) University of Eastern Finland, Finland

Although temporal information of speech has been shown to play an important role in perception, most of the voice conversion approaches assume the speech frames are independent of each other, thereby ignoring the temporal information. In this study, we improve conventional unit selection approach by using exemplars which span multiple frames as base units, and also take temporal information constraint into voice conversion by using overlapping frames to generate speech parameters. This approach thus provides more stable concatenation cost and avoids discontinuity problem in conventional unit selection approach. The proposed method also keeps away from the over-smoothing problem in the mainstream joint density Gaussian mixture model (JD-GMM) based conversion method by directly using target speaker's training data for synthesizing the converted speech. Both objective and subjective evaluations indicate that our proposed method outperforms JD-GMM and conventional unit selection methods.

Full Paper

Bibliographic reference.  Wu, Zhizheng / Virtanen, Tuomas / Kinnunen, Tomi / Chng, Eng Siong / Li, Haizhou (2013): "Exemplar-based unit selection for voice conversion utilizing temporal information", In INTERSPEECH-2013, 3057-3061.