11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Learning from Human Errors: Prediction of Phoneme Confusions Based on Modified ASR Training

Bernd T. Meyer, Birger Kollmeier

Carl von Ossietzky Universität Oldenburg, Germany

In an attempt to improve models of human perception, the recognition of phonemes in nonsense utterances was predicted with automatic speech recognition (ASR) in order to analyze its applicability for modeling human speech recognition (HSR) in noise. In the first experiments, several feature types are used as input for an ASR system; the resulting phoneme scores are compared to listening experiments using the same speech data. With conventional training, the highest correlation between predicted and measured recognition was observed for perceptual linear prediction features (r = 0.84). Secondly, a new training paradigm for ASR is proposed with the aim of improving the prediction of phoneme intelligibility. For this ‘perceptual training’, the original utterance labels are modified based on the confusions measured in HSR tests. The modified ASR training improved the overall prediction, with the best models (r = 0.89) exceeding those obtained with conventional training (r = 0.80).

Full Paper

Bibliographic reference.  Meyer, Bernd T. / Kollmeier, Birger (2010): "Learning from human errors: prediction of phoneme confusions based on modified ASR training", In INTERSPEECH-2010, 1209-1212.