Evaluation of spoken dialogue systems is in the main interest of the application developer. During the whole development cycle reliable and straightforwardly interpretable measures are needed in order to identify weak points of the user interface and the actual implementation. This paper proposes two issues. First, a visualisation method is introduced in order to follow what exactly happens in spoken dialogues during the interaction and thus giving means for system developers to explore dialogue paths explicitly in a statistical sense. The formalism of the visualisation process is explained and examples are given for different interaction types. The second issue is the introduction of a measure derived directly from the visualisation method. This measure is a sort of combination of traditional success rate and average number of system-user turns. The measure provides means for system developers to compare the average system performance to a pre-defined interaction described by a dialogue path. Example is given with a speaker-independent name dialling application.
Cite as: Boda, P.P. (2000) Visualisation of spoken dialogues. Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000), vol. 1, 146-149, doi: 10.21437/ICSLP.2000-36
@inproceedings{boda00_icslp,
author={Péter Pál Boda},
title={{Visualisation of spoken dialogues}},
year=2000,
booktitle={Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000)},
pages={vol. 1, 146-149},
doi={10.21437/ICSLP.2000-36}
}