12th Annual Conference of the International Speech Communication Association

Florence, Italy
August 27-31. 2011

Combining Feature Space Discriminative Training with Long-Term Spectro-Temporal Features for Noise-Robust Speech Recognition

Takashi Fukuda, Osamu Ichikawa, Masafumi Nishimura

IBM Research - Tokyo, Japan

Discriminative training of feature space using maximum mutual information (fMMI) objective function has been shown to yield remarkable accuracy improvements. For noisy environments, fMMI can be regarded as an effective noise compensation algorithm and can play a significant role for noise robustness. Feature space speaker adaptation techniques such as feature space maximum likelihood linear regression (fMLLR) are also well known, suitable for mismatched test data. These feature space transform algorithms are essential for modern speech recognition but still need further improvement against low SNR conditions. In contrast, longterm spectro-temporal information has also received attention to support traditional short-term features. We previously proposed long-term temporal features to improve ASR accuracy for low SNR speech. In this paper, we show that long-term temporal features can be combined with fMMI to build more discriminative models for noisy speech and the proposed method performed favorably at low SNR conditions.

Full Paper

Bibliographic reference.  Fukuda, Takashi / Ichikawa, Osamu / Nishimura, Masafumi (2011): "Combining feature space discriminative training with long-term spectro-temporal features for noise-robust speech recognition", In INTERSPEECH-2011, 229-232.