EUROSPEECH 2001 Scandinavia
7th European Conference on Speech Communication and Technology
2nd INTERSPEECH Event

Aalborg, Denmark
September 3-7, 2001

                 

DARPA Communicator Dialog Travel Planning Systems: The June 2000 Data Collection

Marilyn Walker (1), J. Aberdeen (2), J. Boland (3), E. Bratt (4), J. Garofolo (5), Lynette Hirschman (2), A. Le (5), S. Lee (1), Shrikanth Narayanan (1), K. Papineni (6), Bryan Pellom (7), Joseph Polifroni (8), Alexandros Potamianos (9), P. Prabhu (1), Alexander I. Rudnicky (10), G. Sanders (5), Stephanie Seneff (8), D. Stallard (11), Steve Whittaker (1)

(1) AT&T Labs, USA; (2) MITRE, USA; (3) University of Louisiana, USA; (4) SRI International, USA; (5) NIST, USA; (6) IBM, USA; (7) University of Colorado, USA; (8) MIT, USA; (9) Lucent Bell Labs, USA; (10) Carnegie Mellon University, USA; (11) BBN Technologies, USA

This paper describes results of an experiment with 9 different DARPA Communicator systems who participated in the June 2000 Data collection. All Systems supported travel planning and utilized some form of mixed initiative interaction. However they varied in several critical dimensions: (1) They targeted different back-end databases for travel information; (2) They used different modules for ASR, NLU, TTS and dialog management. We describe the experimental design, the approach to data collection, the metrics collected, and results comparing the systems.

Full Paper

Bibliographic reference.  Walker, Marilyn / Aberdeen, J. / Boland, J. / Bratt, E. / Garofolo, J. / Hirschman, Lynette / Le, A. / Lee, S. / Narayanan, Shrikanth / Papineni, K. / Pellom, Bryan / Polifroni, Joseph / Potamianos, Alexandros / Prabhu, P. / Rudnicky, Alexander I. / Sanders, G. / Seneff, Stephanie / Stallard, D. / Whittaker, Steve (2001): "DARPA communicator dialog travel planning systems: the june 2000 data collection", In EUROSPEECH-2001, 1371-1374.