10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Margin-Space Integration of MPE Loss via Differencing of MMI Functionals for Generalized Error-Weighted Discriminative Training

Erik McDermott, Shinji Watanabe, Atsushi Nakamura

NTT Corporation, Japan

Using the central observation that margin-based weighted classification error (modeled using Minimum Phone Error (MPE)) corresponds to the derivative with respect to the margin term of margin-based hinge loss (modeled using Maximum Mutual Information (MMI)), this article subsumes and extends marginbased MPE and MMI within a broader framework in which the objective function is an integral of MPE loss over a range of margin values. Applying the Fundamental Theorem of Calculus, this integral is easily evaluated using finite differences of MMI functionals; lattice-based training using the new criterion can then be carried out using differences of MMI gradients. Experimental results comparing the new framework with margin-based MMI, MCE and MPE on the Corpus of Spontaneous Japanese and the MIT OpenCourseWare/MIT-World corpus are presented.

Full Paper

Bibliographic reference.  McDermott, Erik / Watanabe, Shinji / Nakamura, Atsushi (2009): "Margin-space integration of MPE loss via differencing of MMI functionals for generalized error-weighted discriminative training", In INTERSPEECH-2009, 224-227.