8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Analysis of Communication Failures for Spoken Dialogue Systems

Sebastian Möller, Klaus-Peter Engelbrecht, Antti Oulasvirta

Technische Universität Berlin, Germany

Communication failures are typical for interactions with spoken dialogue systems, in particular when dialogues get less structured and less foreseeable. In this paper, we adopt a new classification scheme of communication failures and their consequences and show its usefulness in three respects: (1) For the systematic analysis of data collected in user testing, (2) for the prediction of user-perceived quality and usability, and (3) for the automatic testing of usability in a simulation testbed. Experimental results are presented for two spoken dialogue systems which differ in their dialogue structure and complexity. They show that the failure classification may uncover the causes of interaction problems between user and system, irrespective of system complexity, and that failure consequences can serve as a predictor of user satisfaction.

Full Paper

Bibliographic reference.  Möller, Sebastian / Engelbrecht, Klaus-Peter / Oulasvirta, Antti (2007): "Analysis of communication failures for spoken dialogue systems", In INTERSPEECH-2007, 134-137.