9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Simultaneous Conversion of Duration and Spectrum Based on Statistical Models Including Time-Sequence Matching

Kaori Yutani (1), Yosuke Uto (1), Yoshihiko Nankaku (1), Tomoki Toda (2), Keiichi Tokuda (1)

(1) Nagoya Institute of Technology, Japan; (2) NAIST, Japan

This paper describes a simultaneous conversion technique of duration and spectrum based on a statistical model including time-sequence matching. Conventional GMM-based approaches cannot perform spectral conversion taking account of speaking rate because it assumes one to one frame matching between source and target features. However, speaker characteristics may appear in speaking rates. In order to perform duration conversion, we attach duration models to statistical models including timesequence matching (DPGMM). Since DPGMM can represent two different length sequences directly, the conversion of spectrum and duration can be performed within an integrated framework. In the proposed technique, each mixture component of DPGMM has different duration transformation functions, therefore durations are converted nonlinearly and dependently on spectral information. In the subjective DMOS test, the proposed method is superior to the conventional method.

Full Paper

Bibliographic reference.  Yutani, Kaori / Uto, Yosuke / Nankaku, Yoshihiko / Toda, Tomoki / Tokuda, Keiichi (2008): "Simultaneous conversion of duration and spectrum based on statistical models including time-sequence matching", In INTERSPEECH-2008, 1072-1075.