Mispronunciation Detection Leveraging Maximum Performance Criterion Training of Acoustic Models and Decision Functions

Yao-Chi Hsu, Ming-Han Yang, Hsiao-Tsung Hung, Berlin Chen


Mispronunciation detection is part and parcel of a computer assisted pronunciation training (CAPT) system, facilitating second-language (L2) learners to pinpoint erroneous pronunciations in a given utterance so as to improve their spoken proficiency. This paper presents a continuation of such a general line of research and the major contributions are twofold. First, we present an effective training approach that estimates the deep neural network based acoustic models involved in the mispronunciation detection process by optimizing an objective directly linked to the ultimate evaluation metric. Second, along the same vein, two disparate logistic sigmoid based decision functions with either phone- or senone-dependent parameterization are also inferred and used for enhanced mispronunciation detection. A series of experiments on a Mandarin mispronunciation detection task seem to show the performance merits of the proposed method.


DOI: 10.21437/Interspeech.2016-1602

Cite as

Hsu, Y., Yang, M., Hung, H., Chen, B. (2016) Mispronunciation Detection Leveraging Maximum Performance Criterion Training of Acoustic Models and Decision Functions. Proc. Interspeech 2016, 2646-2650.

Bibtex
@inproceedings{Hsu+2016,
author={Yao-Chi Hsu and Ming-Han Yang and Hsiao-Tsung Hung and Berlin Chen},
title={Mispronunciation Detection Leveraging Maximum Performance Criterion Training of Acoustic Models and Decision Functions},
year=2016,
booktitle={Interspeech 2016},
doi={10.21437/Interspeech.2016-1602},
url={http://dx.doi.org/10.21437/Interspeech.2016-1602},
pages={2646--2650}
}