ESCA - NATO/RSG 10 Workshop on
Applications of Speech Technology

Lautrach, Germany
September 16-17, 1993

Usability Analysis of Intelligent Dialogues for Automated Telephone Services

Mervyn A. Jack (1), J. C. Foster (1), F. W. Stentiford (2)

(1) University of Edinburgh, UK
(2) British Telecom Laboratories, Martlesham, UK

This paper describes work carried out as part of a five year research project to investigate the design, implementation and evaluation of dialogues for automated telephone services. The project involves a series of large-scale field experiments using a new Wizard of Oz (WOZ) scheme for the investigation of the perceived usability of such services. The WOZ experimental workbench is based around a simulation of a speech recognition system with selectable performance characteristics, allowing experiments to be carried out with recogniser performance capabilities extrapolated beyond the current state-of-the-art. The WOZ system also possesses a fully integrated dialogue component which can be independently modified to suit different experimental objectives. Experiments using the WOZ scheme are described with details of the user evaluation measures employed in the research, together with experimental results.

Full Paper

Bibliographic reference.  Jack, Mervyn A. / Foster, J. C. / Stentiford, F. W. (1993): "Usability analysis of intelligent dialogues for automated telephone services", In AST-1993, 149-152.