This paper describes results of an experiment with 9 different DARPA Communicator systems who participated in the June 2000 Data collection. All Systems supported travel planning and utilized some form of mixed initiative interaction. However they varied in several critical dimensions: (1) They targeted different back-end databases for travel information; (2) They used different modules for ASR, NLU, TTS and dialog management. We describe the experimental design, the approach to data collection, the metrics collected, and results comparing the systems.
Cite as: Walker, M., Aberdeen, J., Boland, J., Bratt, E., Garofolo, J., Hirschman, L., Le, A., Lee, S., Narayanan, S., Papineni, K., Pellom, B., Polifroni, J., Potamianos, A., Prabhu, P., Rudnicky, A.I., Sanders, G., Seneff, S., Stallard, D., Whittaker, S. (2001) DARPA communicator dialog travel planning systems: the june 2000 data collection. Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001), 1371-1374, doi: 10.21437/Eurospeech.2001-355
@inproceedings{walker01_eurospeech,
author={Marilyn Walker and J. Aberdeen and J. Boland and E. Bratt and J. Garofolo and Lynette Hirschman and A. Le and S. Lee and Shrikanth Narayanan and K. Papineni and Bryan Pellom and Joseph Polifroni and Alexandros Potamianos and P. Prabhu and Alexander I. Rudnicky and G. Sanders and Stephanie Seneff and D. Stallard and Steve Whittaker},
title={{DARPA communicator dialog travel planning systems: the june 2000 data collection}},
year=2001,
booktitle={Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001)},
pages={1371--1374},
doi={10.21437/Eurospeech.2001-355}
}