INTERSPEECH 2004 - ICSLP
8th International Conference on Spoken Language Processing

Jeju Island, Korea
October 4-8, 2004

Modeling Auxiliary Features in Tandem Systems

Mathew Magimai Doss (1), Shajith Ikbal (1), Todd Stephenson (2), Hervé Bourlard (1)

(1) Swiss Federal Institute of Technology (EPFL), Switzerland
(2) Carnegie Mellon University, USA

Tandem systems transform the cepstral features into posterior probabilities of subword units using an artificial neural networks (ANNs), which are processed to form input features for conventional speech recognition systems. They have been shown to perform better than conventional speech recognition systems using cepstral features. Recent studies have shown that modelling cepstral features with auxiliary sources of knowledge leads to improvement in the performance of speech recognition systems. In this paper, we study two approaches to incorporate auxiliary knowledge sources such as pitch frequency, short-term energy, etc. (referred to as auxiliary features), in a tandem-based automatic speech recognition system. In the first approach, we model the auxiliary features in the process of training ANNs, which are later used to extract tandem-features. In the second approach, we extract the tandem-features from an ANN trained with cepstral features only and then model them jointly with auxiliary features. Recognition studies conducted on a connected word recognition task under clean and noisy conditions show that the performance of the tandem system can be improved by incorporating auxiliary features.

Full Paper

Bibliographic reference.  Doss, Mathew Magimai / Ikbal, Shajith / Stephenson, Todd / Bourlard, Hervé (2004): "Modeling auxiliary features in tandem systems", In INTERSPEECH-2004, 1501-1504.