ISCA Archive Interspeech 2009
ISCA Archive Interspeech 2009

A fast online algorithm for large margin training of continuous density hidden Markov models

Chih-Chieh Cheng, Fei Sha, Lawrence K. Saul

We propose an online learning algorithm for large margin training of continuous density hidden Markov models. The online algorithm updates the model parameters incrementally after the decoding of each training utterance. For large margin training, the algorithm attempts to separate the log-likelihoods of correct and incorrect transcriptions by an amount proportional to their Hamming distance. We evaluate this approach to hidden Markov modeling on the TIMIT speech database. We find that the algorithm yields significantly lower phone error rates than other approaches¬óboth online and batch ¬ó that do not attempt to enforce a large margin. We also find that the algorithm converges much more quickly than analogous batch optimizations for large margin training.


doi: 10.21437/Interspeech.2009-233

Cite as: Cheng, C.-C., Sha, F., Saul, L.K. (2009) A fast online algorithm for large margin training of continuous density hidden Markov models. Proc. Interspeech 2009, 668-671, doi: 10.21437/Interspeech.2009-233

@inproceedings{cheng09b_interspeech,
  author={Chih-Chieh Cheng and Fei Sha and Lawrence K. Saul},
  title={{A fast online algorithm for large margin training of continuous density hidden Markov models}},
  year=2009,
  booktitle={Proc. Interspeech 2009},
  pages={668--671},
  doi={10.21437/Interspeech.2009-233}
}