12th Annual Conference of the International Speech Communication Association

Florence, Italy
August 27-31. 2011

Phonological Knowledge Guided HMM State Mapping for Cross-Lingual Speaker Adaptation

Hui Liang, John Dines

Idiap Research Institute, Switzerland

Within the HMM state mapping-based cross-lingual speaker adaptation framework, the minimum Kullback-Leibler divergence criterion has been typically employed to measure the similarity of two average voice state distributions from two respective languages for state mapping construction. Considering that this simple criterion doesn't take any language-specific information into account, we propose a data-driven, phonological knowledge guided approach to strengthen the mapping construction . state distributions from the two languages are clustered according to broad phonetic categories using decision trees and mapping rules are constructed only within each of the clusters. Objective evaluation of our proposed approach demonstrates reduction of mel-cepstral distortion and that mapping rules derived from a single training speaker generalize to other speakers, with subtle improvement being detected during subjective listening tests.

Full Paper

Bibliographic reference.  Liang, Hui / Dines, John (2011): "Phonological knowledge guided HMM state mapping for cross-lingual speaker adaptation", In INTERSPEECH-2011, 1825-1828.