9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Two-Stage Prosody Prediction for Emotional Text-to-Speech Synthesis

Hao Tang, Xi Zhou, Matthias Odisio, Mark Hasegawa-Johnson, Thomas S. Huang

University of Illinois at Urbana-Champaign, USA

In this paper, we adopt a difference approach to prosody prediction for emotional text-to-speech synthesis, where the prosodic variations between emotional and neutral speech are decomposed into the global and local prosodic variations and predicted using a twostage model. The global prosodic variations are modeled by the means and standard deviations of the prosodic parameters, while the local prosodic variations are modeled by the classification and regression tree (CART) and dynamic programming. The proposed two-stage prosody prediction model has been successfully implemented as a prosodic module in a Festival-MBROLA architecture based emotional text-to-speech synthesis system, which is able to synthesize highly intelligible, natural and expressive speech.

Full Paper

Bibliographic reference.  Tang, Hao / Zhou, Xi / Odisio, Matthias / Hasegawa-Johnson, Mark / Huang, Thomas S. (2008): "Two-stage prosody prediction for emotional text-to-speech synthesis", In INTERSPEECH-2008, 2138-2141.