9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

An On-Line Adaptation Technique for Emotional Speech Recognition Using Style Estimation with Multiple-Regression HMM

Yusuke Ijima, Makoto Tachibana, Takashi Nose, Takao Kobayashi

Tokyo Institute of Technology, Japan

This paper describes a model adaptation technique for emotional speech recognition based on multiple-regression HMM (MR-HMM).We use a low-dimensional vector called style vector which corresponds the degree of expressivity of emotional speech as the explanatory variable of the regression. In the proposed technique, first, the value of the style vector for input speech is estimated. Then, using the estimated style vector, new mean vectors of the output distributions of HMM are adapted to the input style. The style vector is estimated every input utterance, and an on-line adaptation can be done in each utterance. We perform phoneme recognition experiments for professional narrators' acted speech and evaluate the performance by comparing with style-dependent and style-independent HMMs. Experimental results show the proposed technique reduced the error rates by 11% of the style-independent model.

Full Paper

Bibliographic reference.  Ijima, Yusuke / Tachibana, Makoto / Nose, Takashi / Kobayashi, Takao (2008): "An on-line adaptation technique for emotional speech recognition using style estimation with multiple-regression HMM", In INTERSPEECH-2008, 1297-1300.