16th Annual Conference of the International Speech Communication Association

Dresden, Germany
September 6-10, 2015

A Multi-Channel Speech Enhancement Framework for Robust NMF-Based Speech Recognition for Speech-Impaired Users

Gert Dekkers, Toon van Waterschoot, Bart Vanrumste, Bert Van Den Broeck, Jort F. Gemmeke, Hugo Van hamme, Peter Karsmakers

Katholieke Universiteit Leuven, Belgium

In this paper a multi-channel speech enhancement framework for distant speech acquisition in noisy and reverberant environments for Non-negative Matrix Factorization (NMF)-based Automatic Speech Recognition (ASR) is proposed. The system is evaluated for its use in an assistive vocal interface for physically impaired and speech-impaired users. The framework utilises the Spatially Pre-processed Speech Distortion Weighted Multi-channel Wiener Filter (SP-SDW-MWF) in combination with a postfilter to reduce noise and reverberation. Additionally, the estimation uncertainty of the speech enhancement framework is propagated through the Mel-Frequency Cepstrum Coefficients (MFCC) feature extraction to allow for feature compensation in a later stage. Results indicate that a) using a trade-off parameter between noise reduction and speech distortion has a positive effect on the recognition performance with respect to the well-known GSC and MWF and b) the addition of a post-filter and the feature compensation increases performance with respect to several baselines for a non-pathological and pathological speaker.

Full Paper

Bibliographic reference.  Dekkers, Gert / Waterschoot, Toon van / Vanrumste, Bart / Broeck, Bert Van Den / Gemmeke, Jort F. / hamme, Hugo Van / Karsmakers, Peter (2015): "A multi-channel speech enhancement framework for robust NMF-based speech recognition for speech-impaired users", In INTERSPEECH-2015, 746-750.