16th Annual Conference of the International Speech Communication Association

Dresden, Germany
September 6-10, 2015

Improving Speech Recognition and Keyword Search for Low Resource Languages Using Web Data

Gideon Mendels (1), Erica Cooper (1), Victor Soto (1), Julia Hirschberg (1), Mark J. F. Gales (2), Kate M. Knill (2), Anton Ragni (2), Haipeng Wang (2)

(1) Columbia University, USA
(2) University of Cambridge, UK

We describe the use of text data scraped from the web to augment language models for Automatic Speech Recognition and Keyword Search for Low Resource Languages. We scrape text from multiple genres including blogs, online news, translated TED talks, and subtitles. Using linearly interpolated language models, we find that blogs and movie subtitles are more relevant for language modeling of conversational telephone speech and obtain large reductions in out-of-vocabulary keywords. Furthermore, we show that the web data can improve Term Error Rate Performance by 3.8% absolute and Maximum Term-Weighted Value in Keyword Search by 0.0076-0.1059 absolute points. Much of the gain comes from the reduction of out-of-vocabulary items.

Full Paper

Bibliographic reference.  Mendels, Gideon / Cooper, Erica / Soto, Victor / Hirschberg, Julia / Gales, Mark J. F. / Knill, Kate M. / Ragni, Anton / Wang, Haipeng (2015): "Improving speech recognition and keyword search for low resource languages using web data", In INTERSPEECH-2015, 829-833.