This paper briefly reviews current-practice usability evaluation methods and criteria for spoken dialogue systems. We then describe how two commercial and one research system were evaluated with respect to usability and discuss similarities and differences. Finally, we discuss the industrial need for cheaper ways of evaluating usability and the need to pursue research on usability in a field in which the technological capabilities of systems continue to improve and diversify at a rapid pace.
Cite as: Dybkjær, L., Bernsen, N.O., Dybkjær, H. (2005) Usability evaluation issues in commercial and research systems. Proc. Applied Spoken Language Interaction in Distributed Environments (ASIDE 2005), paper 29
@inproceedings{dybkjr05_aside,
author={Laila Dybkjær and Niels Ole Bernsen and Hans Dybkjær},
title={{Usability evaluation issues in commercial and research systems}},
year=2005,
booktitle={Proc. Applied Spoken Language Interaction in Distributed Environments (ASIDE 2005)},
pages={paper 29}
}