ISCA Archive Interspeech 2008
ISCA Archive Interspeech 2008

Parameter clustering and sharing in variable-parameter HMMs for noise robust speech recognition

Dong Yu, Li Deng, Yifan Gong, Alex Acero

Recently we proposed a cubic-spline-based variable-parameter hidden Markov model (CS-VPHMM) whose mean and variance parameters vary according to some cubic spline functions of additional environment-dependent parameters. We have shown good properties of the CS-VPHMM and demonstrated on the Aurora-3 corpus that MCE-trained CS-VPHMM greatly outperforms the MCE-trained conventional HMM at the cost of increased total number of model parameters. In this paper, we propose to share spline functions across different Gaussian mixture components to reduce the total number of model parameters and develop a clustering algorithm to do so. We demonstrate the effectiveness of our parameter clustering and sharing algorithm for the CS-VPHMM on Aurora-3 corpus and show that proper parameter sharing can reduce the number of parameters from 4 times of that used in the conventional HMM to 1.13 times and still get 18% relative WER reduction over the MCE trained conventional HMM under the well-matched condition. Effective parameter sharing makes the CS-VPHMM an attractive model for noise robustness.


doi: 10.21437/Interspeech.2008-301

Cite as: Yu, D., Deng, L., Gong, Y., Acero, A. (2008) Parameter clustering and sharing in variable-parameter HMMs for noise robust speech recognition. Proc. Interspeech 2008, 1253-1256, doi: 10.21437/Interspeech.2008-301

@inproceedings{yu08b_interspeech,
  author={Dong Yu and Li Deng and Yifan Gong and Alex Acero},
  title={{Parameter clustering and sharing in variable-parameter HMMs for noise robust speech recognition}},
  year=2008,
  booktitle={Proc. Interspeech 2008},
  pages={1253--1256},
  doi={10.21437/Interspeech.2008-301}
}