Fusion Strategies for Robust Speech Recognition and Keyword Spotting for Channel- and Noise-Degraded Speech

Vikramjit Mitra, Julien VanHout, Wen Wang, Chris Bartels, Horacio Franco, Dimitra Vergyri, Abeer Alwan, Adam Janin, John H.L. Hansen, Richard M. Stern, Abhijeet Sangwan, Nelson Morgan


Recognizing speech under high levels of channel and/or noise degradation is challenging. Current state-of-the-art automatic speech recognition systems are sensitive to changing acoustic conditions, which can cause significant performance degradation. Noise-robust acoustic features can improve speech recognition performance under varying background conditions, where it is usually observed that robust modeling techniques and multiple system fusion can help to improve the performance even further. This work investigates a wide array of robust acoustic features that have been previously used to successfully improve speech recognition robustness. We use these features to train individual acoustic models, and we analyze their individual performance. We investigate and report results for simple feature combination, feature-map combination at the output of convolutional layers, and fusion of deep neural nets at the senone posterior level. We report results for speech recognition on a large-vocabulary, noise- and channel-degraded Levantine Arabic speech corpus distributed through the Defense Advance Research Projects Agency (DARPA) Robust Automatic Speech Transcription (RATS) program. In addition, we report keyword spotting results to demonstrate the effect of robust features and multiple levels of information fusion.


DOI: 10.21437/Interspeech.2016-279

Cite as

Mitra, V., VanHout, J., Wang, W., Bartels, C., Franco, H., Vergyri, D., Alwan, A., Janin, A., Hansen, J.H., Stern, R.M., Sangwan, A., Morgan, N. (2016) Fusion Strategies for Robust Speech Recognition and Keyword Spotting for Channel- and Noise-Degraded Speech. Proc. Interspeech 2016, 3683-3687.

Bibtex
@inproceedings{Mitra+2016,
author={Vikramjit Mitra and Julien VanHout and Wen Wang and Chris Bartels and Horacio Franco and Dimitra Vergyri and Abeer Alwan and Adam Janin and John H.L. Hansen and Richard M. Stern and Abhijeet Sangwan and Nelson Morgan},
title={Fusion Strategies for Robust Speech Recognition and Keyword Spotting for Channel- and Noise-Degraded Speech},
year=2016,
booktitle={Interspeech 2016},
doi={10.21437/Interspeech.2016-279},
url={http://dx.doi.org/10.21437/Interspeech.2016-279},
pages={3683--3687}
}