10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Evaluating the Potential Utility of ASR N-Best Lists for Incremental Spoken Dialogue Systems

Timo Baumann, Okko Buß, Michaela Atterer, David Schlangen

Universität Potsdam, Germany

The potential of using ASR n-best lists for dialogue systems has often been recognised (if less often realised): it is often the case that even when the top-ranked hypothesis is erroneous, a better one can be found at a lower rank. In this paper, we describe metrics for evaluating whether the same potential carries over to incremental dialogue systems, where ASR output is consumed and reacted upon while speech is still ongoing. We show that even small N can provide an advantage for semantic processing, at a cost of a computational overhead.

Full Paper

Bibliographic reference.  Baumann, Timo / Buß, Okko / Atterer, Michaela / Schlangen, David (2009): "Evaluating the potential utility of ASR n-best lists for incremental spoken dialogue systems", In INTERSPEECH-2009, 1031-1034.