10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Talking Heads for Interacting with Spoken Dialog Smart-Home Systems

Christine Kühnel, Benjamin Weiss, Sebastian Möller

Deutsche Telekom Laboratories, Germany

Finding suitable evaluation methods is an indispensable task during the development of new user interfaces, as no standardized approach has so far been established, especially for multimodal interfaces. In the current study, we used several data sources (direct and indirect measurements) to evaluate a multimodal version of an information system, tested on trained and untrained users. We investigated the extent to which the different types of data showed concordance concerning the perceived quality of the system, in order to derive clues as to the suitability of the respective evaluation methods. The aim was to examine, if widely used methods not originally developed for multimodal interfaces are appropriate under these conditions, and to derive new evaluation paradigms.

Full Paper

Bibliographic reference.  Kühnel, Christine / Weiss, Benjamin / Möller, Sebastian (2009): "Talking heads for interacting with spoken dialog smart-home systems", In INTERSPEECH-2009, 304-307.