8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

An HMM Acoustic Model Incorporating Various Additional Knowledge Sources

Sakriani Sakti, Konstantin Markov, Satoshi Nakamura

NICT, Japan

We introduce a method of incorporating additional knowledge sources into an HMM-based statistical acoustic model. The probabilistic relationship between information sources is first learned through a Bayesian network to easily integrate any additional knowledge sources that might come from any domain and then the global joint probability density function (PDF) of the model is formulated. Where the model becomes too complex and direct BN inference is intractable, we utilize a junction tree algorithm to decompose the global joint PDF into a linked set of local conditional PDFs. This way, a simplified form of the model can be constructed and reliably estimated using a limited amount of training data. Here, we apply this framework to incorporate accents, gender, and wide-phonetic knowledge information at the HMM phonetic model level. The performance of the proposed method was evaluated on an LVCSR task using two different types of accented English speech data. Experimental results revealed that our method improves word accuracy with respect to standard HMM.

Full Paper

Bibliographic reference.  Sakti, Sakriani / Markov, Konstantin / Nakamura, Satoshi (2007): "An HMM acoustic model incorporating various additional knowledge sources", In INTERSPEECH-2007, 2117-2120.