11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Long Short-Term Memory Networks for Noise Robust Speech Recognition

Martin Wöllmer, Yang Sun, Florian Eyben, Björn Schuller

Technische Universität München, Germany

In this paper we introduce a novel hybrid model architecture for speech recognition and investigate its noise robustness on the Aurora 2 database. Our model is composed of a bidirectional Long Short-Term Memory (BLSTM) recurrent neural net exploiting long-range context information for phoneme prediction and a Dynamic Bayesian Network (DBN) for decoding. The DBN is able to learn pronunciation variants as well as typical phoneme confusions of the BLSTM predictor in order to compensate signal disturbances. Unlike conventional Hidden Markov Model (HMM) systems, the proposed architecture is not based on Gaussian mixture modeling. Even without any feature enhancement, our BLSTM-DBN system outperforms a baseline HMM recognizer by up to 18%.

Full Paper

Bibliographic reference.  Wöllmer, Martin / Sun, Yang / Eyben, Florian / Schuller, Björn (2010): "Long short-term memory networks for noise robust speech recognition", In INTERSPEECH-2010, 2966-2969.