INTERSPEECH 2013 14thAnnual Conference of the International Speech Communication Association Lyon, France August 25-29, 2013

Web Data Harvesting for Speech Understanding Grammar Induction

Ioannis Klasinas (1), Alexandros Potamianos (1), Elias Iosif (1), Spiros Georgiladakis (1), Gianluca Mameli (2)

(1) Technical University of Crete, Greece
(2) Expert System, Italy

The development of a speech understanding grammar for spoken dialogue systems can be greatly accelerated by using an in-domain corpus. The development of such a corpus, however, is a slow and expensive process. This paper proposes unsupervised, languageagnostic methods for finding relevant corpora in the web and mining the most informative parts. We show that by utilizing perplexity we are able to increase the in-domainess (precision) of the mined corpora, while by utilizing pragmatic constraints and search engine rank we can increase the generalizability (recall). We show that automatic grammar induction algorithms achieve superior performance on the automatically mined corpora compared to in-domain manually collected corpora for a travel application.

Full Paper

Bibliographic reference.  Klasinas, Ioannis / Potamianos, Alexandros / Iosif, Elias / Georgiladakis, Spiros / Mameli, Gianluca (2013): "Web data harvesting for speech understanding grammar induction", In INTERSPEECH-2013, 2733-2737.