EUROSPEECH 2001 Scandinavia
This paper describes results of an experiment with 9 different DARPA Communicator systems who participated in the June 2000 Data collection. All Systems supported travel planning and utilized some form of mixed initiative interaction. However they varied in several critical dimensions: (1) They targeted different back-end databases for travel information; (2) They used different modules for ASR, NLU, TTS and dialog management. We describe the experimental design, the approach to data collection, the metrics collected, and results comparing the systems.
Bibliographic reference. Walker, Marilyn / Aberdeen, J. / Boland, J. / Bratt, E. / Garofolo, J. / Hirschman, Lynette / Le, A. / Lee, S. / Narayanan, Shrikanth / Papineni, K. / Pellom, Bryan / Polifroni, Joseph / Potamianos, Alexandros / Prabhu, P. / Rudnicky, Alexander I. / Sanders, G. / Seneff, Stephanie / Stallard, D. / Whittaker, Steve (2001): "DARPA communicator dialog travel planning systems: the june 2000 data collection", In EUROSPEECH-2001, 1371-1374.