Sixth European Conference on Speech Communication and Technology

Budapest, Hungary
September 5-9, 1999

Dialog Analysis in the Carnegie Mellon Communicator

Paul C. Constantinides, Alexander I. Rudnicky

School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA

In this paper, we present a formative evaluation procedure that we have applied to the Communicator dialog system. In the system improvement process, we have recognized the need to identify interaction failures through passive observation of system use. By systematizing the process of dialog evaluation, we hope to gain a mechanism for effectively communicating descriptions of interaction failures, specifically for use in system improvement. Additionally, we argue that this process can be taught to and executed by an evaluator external to the system development process, with the same proficiency as someone intimately familiar with the mechanics of the system components.

Full Paper (PDF)

Bibliographic reference.  Constantinides, Paul C. / Rudnicky, Alexander I. (1999): "Dialog analysis in the carnegie mellon communicator", In EUROSPEECH'99, 243-246.