ISCA Archive Interspeech 2008
ISCA Archive Interspeech 2008

Nonnative speech recognition based on state-candidate bilingual model modification

Qingqing Zhang, Ta Li, Jielin Pan, Yonghong Yan

The speech recognition accuracy has been observed to decrease for nonnative speakers, especially those who are just beginning to learn foreign language or who have heavy accents. This paper presents a novel bilingual model modification approach to improve nonnative speech recognition, considering these great variations of accented pronunciations. Each state of the baseline nonnative acoustic models is modified with several candidate states from the auxiliary acoustic models, which are trained by speakers' mother language. State mapping criterion and n-best candidates are investigated based on a grammar-constrained speech recognition system. Using the state-candidate bilingual model modification approach, compared to the nonnative acoustic models which have already been well trained by adaptation technique MAP, a Relative reduction of 7.87% in Phrase Error Rate (RPhrER) was further achieved.


doi: 10.21437/Interspeech.2008-120

Cite as: Zhang, Q., Li, T., Pan, J., Yan, Y. (2008) Nonnative speech recognition based on state-candidate bilingual model modification. Proc. Interspeech 2008, 2366-2369, doi: 10.21437/Interspeech.2008-120

@inproceedings{zhang08b_interspeech,
  author={Qingqing Zhang and Ta Li and Jielin Pan and Yonghong Yan},
  title={{Nonnative speech recognition based on state-candidate bilingual model modification}},
  year=2008,
  booktitle={Proc. Interspeech 2008},
  pages={2366--2369},
  doi={10.21437/Interspeech.2008-120}
}