Ninth International Conference on Spoken Language Processing

Pittsburgh, PA, USA
September 17-21, 2006

Use of Incrementally Regulated Discriminative Margins in MCE Training for Speech Recognition

Dong Yu, Li Deng, Xiaodong He, Alex Acero

Microsoft Research, USA

In this paper, we report our recent development of a novel discriminative learning technique which embeds the concept of discriminative margin into the well established minimum classification error (MCE) method. The idea is to impose an incrementally adjusted "margin" in the loss function of MCE algorithm so that not only error rates are minimized but also discrimination "robustness" between training and test sets is maintained. Experimental evaluation shows that the use of the margin improves a state-of-the-art MCE method by reducing 17% digit errors and 19% string errors in the TIDigits recognition task. The string error rate of 0.55% and digit error rate of 0.19% we have obtained are the best-ever results reported on this task in the literature.

Full Paper

Bibliographic reference.  Yu, Dong / Deng, Li / He, Xiaodong / Acero, Alex (2006): "Use of incrementally regulated discriminative margins in MCE training for speech recognition", In INTERSPEECH-2006, paper 1410-Thu2A1O.4.