Interspeech'2005 - Eurospeech
In this paper, models are investigated which aim at predicting quality perceived during the interaction with spoken dialogue systems, on the basis of instrumentally or expert-derived interaction parameters. More specifically, it will be evaluated how generic model predictions are when going from one system or user group to the next. In two experiments, user quality judgments have been collected according to a recently standardized framework, and a large number of interaction parameters have been extracted. The results show that both changes in the user group and in the system configuration significantly impact prediction performance. Potential reasons for the observed limitations are discussed.
Bibliographic reference. Möller, Sebastian (2005): "Towards generic quality prediction models for spoken dialogue systems - a case study", In INTERSPEECH-2005, 2489-2492.