12th Annual Conference of the International Speech Communication Association

Florence, Italy
August 27-31. 2011

Improving Non-Native ASR Through Stochastic Multilingual Phoneme Space Transformations

David Imseng, Hervé Bourlard, John Dines, Philip N. Garner, Mathew Magimai-Doss

Idiap Research Institute, Switzerland

We propose a stochastic phoneme space transformation technique that allows the conversion of conditional source phoneme posterior probabilities (conditioned on the acoustics) into target phoneme posterior probabilities. The source and target phonemes can be in any language and phoneme format such as the International Phonetic Alphabet. The novel technique makes use of a Kullback- Leibler divergence based hidden Markov model and can be applied to non-native and accented speech recognition or used to adapt systems to under-resourced languages. In this paper, and in the context of hybrid HMM/MLP recognizers, we successfully apply the proposed approach to non-native English speech recognition on the HIWIRE dataset.

Full Paper

Bibliographic reference.  Imseng, David / Bourlard, Hervé / Dines, John / Garner, Philip N. / Magimai-Doss, Mathew (2011): "Improving non-native ASR through stochastic multilingual phoneme space transformations", In INTERSPEECH-2011, 537-540.