5th International Conference on Spoken Language Processing

Sydney, Australia
November 30 - December 4, 1998

Data-Driven Extensions to HMM Statistical Dependencies

Jeff A. Bilmes

ICSI/U.C. Berkeley, USA

In this paper, a new technique is introduced that relaxes the HMM conditional independence assumption in a principled way. Without increasing the number of states, the modeling power of an HMM is increased by including only those additional probabilistic dependencies (to the surrounding observation context) that are believed to be both relevant and discriminative. Conditional mutual information is used to determine both relevance and discriminability. Extended Gaussian-mixture HMMs and new EM update equations are introduced. In an isolated word speech database, results show an average 34% word error improvement over an HMM with the same number of states, and a 15% improvement over an HMM with a comparable number of parameters.

Full Paper

Bibliographic reference.  Bilmes, Jeff A. (1998): "Data-driven extensions to HMM statistical dependencies", In ICSLP-1998, paper 0894.