We describe the use of text data scraped from the web to augment language models for Automatic Speech Recognition and Keyword Search for Low Resource Languages. We scrape text from multiple genres including blogs, online news, translated TED talks, and subtitles. Using linearly interpolated language models, we find that blogs and movie subtitles are more relevant for language modeling of conversational telephone speech and obtain large reductions in out-of-vocabulary keywords. Furthermore, we show that the web data can improve Term Error Rate Performance by 3.8% absolute and Maximum Term-Weighted Value in Keyword Search by 0.0076-0.1059 absolute points. Much of the gain comes from the reduction of out-of-vocabulary items.
Cite as: Mendels, G., Cooper, E., Soto, V., Hirschberg, J., Gales, M.J.F., Knill, K.M., Ragni, A., Wang, H. (2015) Improving speech recognition and keyword search for low resource languages using web data. Proc. Interspeech 2015, 829-833, doi: 10.21437/Interspeech.2015-260
@inproceedings{mendels15_interspeech,
author={Gideon Mendels and Erica Cooper and Victor Soto and Julia Hirschberg and Mark J. F. Gales and Kate M. Knill and Anton Ragni and Haipeng Wang},
title={{Improving speech recognition and keyword search for low resource languages using web data}},
year=2015,
booktitle={Proc. Interspeech 2015},
pages={829--833},
doi={10.21437/Interspeech.2015-260}
}