ISCA Archive Interspeech 2008
ISCA Archive Interspeech 2008

Improving mispronunciation detection and diagnosis of learners' speech with context-sensitive phonological rules based on language transfer

Alissa M. Harrison, Wing Yiu Lau, Helen M. Meng, Lan Wang

This study demonstrates how knowledge of language transfer can enable a computer-assisted pronunciation teaching (CAPT) system to effectively detect and diagnose salient mispronunciations in second language learners' speech. Our approach uses a HMM-based speech recognizer with an extended pronunciation lexicon that includes both a model pronunciation for each word and common pronunciation variants of our target learners. The pronunciation variants in the extended pronunciation lexicon are generated based on language transfer theory (i.e knowledge from the first language is transferred to the second language). We find that a lexicon that characterizes language transfer using context-sensitive phonological rules can detect and diagnose errors better than a lexicon generated from context-insensitive rules. Furthermore, predicting errors from language transfer alone can approach the performance of a system where the lexicon is fully-informed of all possible pronunciation errors.


doi: 10.21437/Interspeech.2008-471

Cite as: Harrison, A.M., Lau, W.Y., Meng, H.M., Wang, L. (2008) Improving mispronunciation detection and diagnosis of learners' speech with context-sensitive phonological rules based on language transfer. Proc. Interspeech 2008, 2787-2790, doi: 10.21437/Interspeech.2008-471

@inproceedings{harrison08_interspeech,
  author={Alissa M. Harrison and Wing Yiu Lau and Helen M. Meng and Lan Wang},
  title={{Improving mispronunciation detection and diagnosis of learners' speech with context-sensitive phonological rules based on language transfer}},
  year=2008,
  booktitle={Proc. Interspeech 2008},
  pages={2787--2790},
  doi={10.21437/Interspeech.2008-471}
}