Data Selection by Sequence Summarizing Neural Network in Mismatch Condition Training

Kateřina Žmolíková, Martin Karafiát, Karel Veselý, Marc Delcroix, Shinji Watanabe, Lukáš Burget, Jan Černocký


Data augmentation is a simple and efficient technique to improve the robustness of a speech recognizer when deployed in mismatched training-test conditions. Our paper proposes a new approach for selecting data with respect to similarity of acoustic conditions. The similarity is computed based on a sequence summarizing neural network which extracts vectors containing acoustic summary (e.g. noise and reverberation characteristics) of an utterance. Several configurations of this network and different methods of selecting data using these “summary-vectors” were explored. The results are reported on a mismatched condition using AMI training set with the proposed data selection and CHiME3 test set.


DOI: 10.21437/Interspeech.2016-741

Cite as

Žmolíková, K., Karafiát, M., Veselý, K., Delcroix, M., Watanabe, S., Burget, L., Černocký, J. (2016) Data Selection by Sequence Summarizing Neural Network in Mismatch Condition Training. Proc. Interspeech 2016, 2354-2358.

Bibtex
@inproceedings{Žmolíková+2016,
author={Kateřina Žmolíková and Martin Karafiát and Karel Veselý and Marc Delcroix and Shinji Watanabe and Lukáš Burget and Jan Černocký},
title={Data Selection by Sequence Summarizing Neural Network in Mismatch Condition Training},
year=2016,
booktitle={Interspeech 2016},
doi={10.21437/Interspeech.2016-741},
url={http://dx.doi.org/10.21437/Interspeech.2016-741},
pages={2354--2358}
}