7th International Conference on Spoken Language Processing

September 16-20, 2002
Denver, Colorado, USA

Auxiliary Variables in Conditional Gaussian Mixtures for Automatic Speech Recognition

Todd A. Stephenson, Mathew Magimai-Doss, Hervé Bourlard

Dalle Molle Institute for Perceptual Artificial Intelligence, Switzerland

In previous work, we presented a case study using an estimated pitch value as the conditioning variable in conditional Gaussians that showed the utility of hiding the pitch values in certain situations or in modeling it independently of the hidden state in others. Since only single conditional Gaussians were used in that work, we extend that work here to using conditional Gaussian mixtures in the emission distributions to make this work more comparable to state-of-the-art automatic speech recognition. We also introduce a rate-of-speech (ROS) variable within the conditional Gaussian mixtures. We find that, under the current methods, using observed pitch or ROS in the recognition phase does not provide improvement. However, systems trained on pitch or ROS may provide improvement in the recognition phase over the baseline when the pitch or ROS is marginalized out.

Full Paper

Bibliographic reference.  Stephenson, Todd A. / Magimai-Doss, Mathew / Bourlard, Hervé (2002): "Auxiliary variables in conditional Gaussian mixtures for automatic speech recognition", In ICSLP-2002, 2665-2668.