Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Toward Multiple-Language TTS: Experiments in English and Mandarin

Raul Fernandez (1), Wei Zhang (2), Ellen Eide (1), Raimo Bakis (1), Wael Hamza (1), Yi Liu (2), Michael Picheny (1), John F. Pitrelli (1), Yong Qing (2), Zhi Wei Shuang (2), Li Qin Shen (2)

(1) IBM T.J. Watson Research Center, Yorktown Heights, NY, USA; (2) IBM China Research Lab, China

Text-to-speech systems have dramatically improved in recent years through the use of corpus-based concatenative approaches, and we are beginning to see an interest in endowing them with the ability to handle more than the native language for which they have been developed. In this paper we present ongoing work at IBM in text-to-speech systems that can produce high-quality synthesis in more than one language. We illustrate the discussion with a case study in which two systems, originally developed to support English and Mandarin respectively, have been extended to support each other's languages. We describe the challenges faced when adapting one system to a different target language, propose adaptation solutions, and present the results of perceptual tests carried out to evaluate how the approaches compare with the performance of the native systems.

Full Paper

Bibliographic reference.  Fernandez, Raul / Zhang, Wei / Eide, Ellen / Bakis, Raimo / Hamza, Wael / Liu, Yi / Picheny, Michael / Pitrelli, John F. / Qing, Yong / Shuang, Zhi Wei / Shen, Li Qin (2005): "Toward multiple-language TTS: experiments in English and Mandarin", In INTERSPEECH-2005, 1473-1476.