Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Towards Generic Quality Prediction Models for Spoken Dialogue Systems - A Case Study

Sebastian Möller

Ruhr-Universität Bochum, Germany

In this paper, models are investigated which aim at predicting quality perceived during the interaction with spoken dialogue systems, on the basis of instrumentally or expert-derived interaction parameters. More specifically, it will be evaluated how generic model predictions are when going from one system or user group to the next. In two experiments, user quality judgments have been collected according to a recently standardized framework, and a large number of interaction parameters have been extracted. The results show that both changes in the user group and in the system configuration significantly impact prediction performance. Potential reasons for the observed limitations are discussed.

Full Paper

Bibliographic reference.  Möller, Sebastian (2005): "Towards generic quality prediction models for spoken dialogue systems - a case study", In INTERSPEECH-2005, 2489-2492.