9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Articulatory Control of HMM-Based Parametric Speech Synthesis Driven by Phonetic Knowledge

Zhen-Hua Ling (1), Korin Richmond (2), Junichi Yamagishi (2), Ren-Hua Wang (1)

(1) University of Science & Technology of China, China; (2) University of Edinburgh, UK

This paper presents a method to control the characteristics of synthetic speech flexibly by integrating articulatory features into a Hidden Markov Model (HMM)-based parametric speech synthesis system. In contrast to model adaptation and interpolation approaches for speaking style control, this method is driven by phonetic knowledge, and target speech samples are not required. The joint distribution of parallel acoustic and articulatory features considering cross-stream feature dependency is estimated. At synthesis time, acoustic and articulatory features are generated simultaneously based on the maximum-likelihood criterion. The synthetic speech can be controlled flexibly by modifying the generated articulatory features according to arbitrary phonetic rules in the parameter generation process. Our experiments show that the proposed method is effective in both changing the overall character of synthesized speech and in controlling the quality of a specific vowel.

Full Paper

Bibliographic reference.  Ling, Zhen-Hua / Richmond, Korin / Yamagishi, Junichi / Wang, Ren-Hua (2008): "Articulatory control of HMM-based parametric speech synthesis driven by phonetic knowledge", In INTERSPEECH-2008, 573-576.