8th European Conference on Speech Communication and Technology

Geneva, Switzerland
September 1-4, 2003


Hybrid HMM/BN ASR System Integrating Spectrum and Articulatory Features

Konstantin Markov (1), Jianwu Dang (2), Yosuke Iizuka (2), Satoshi Nakamura (1)

(1) ATR-SLT, Japan
(2) JAIST, Japan

In this paper, we describe automatic speech recognition system where features extracted from human speech production system in form of articulatory movements data are effectively integrated in the acoustic model for improved recognition performance. The system is based on the hybrid HMM/BN model, which allows for easy integration of different speech features by modeling probabilistic dependencies between them. In addition, features like articulatory movements, which are difficult or impossible to obtain during recognition, can be left hidden, in fact eliminating the need of their extraction. The system was evaluated in phoneme recognition task on small database consisting of three speakers' data in speaker dependent and multi-speaker modes. In both cases, we obtained higher recognition rates compared to conventional, spectrum based HMM system with the same number of parameters.

Full Paper

Bibliographic reference.  Markov, Konstantin / Dang, Jianwu / Iizuka, Yosuke / Nakamura, Satoshi (2003): "Hybrid HMM/BN ASR system integrating spectrum and articulatory features", In EUROSPEECH-2003, 965-968.