First ISCA ITRW on Auditory Quality of Systems

April 23-25, 2003
Akademie Mont-Cenis, Germany

Quality Evaluation of Bochum Restaurant Information System: A Spoken Dialogue System

Christine S. Pellegrini

Institute of Communication Acoustics, Ruhr-University Bochum, Germany

BoRIS, the Bochumer Restaurant-Information-System, is a spoken dialogue system that returns information about restaurants via telephone. This paper describes an auditory test in which different components of the dialogue system can be changed. Configurations are arranged with different features of the systemís components. All configurations are assessed by subjects. Further, technical parameters are collected, e.g. the dialogueís length, or expert-based parameters, such as transaction success.

Correlations can be found between the features of the systemís components, the technical data, and the assessment by the subjects. The results of this test will be discussed. It is conceivable that these results can be used to improve similar interactive dialogue systems.

Full Paper

Bibliographic reference.  Pellegrini, Christine S. (2003): "Quality evaluation of Bochum Restaurant Information System: A spoken dialogue system", In AQS-2003, 134-138.