5th International Conference on Spoken Language Processing

Sydney, Australia
November 30 - December 4, 1998

Evaluation of Dialog Strategies for a Tourist Information Retrieval System

Laurence Devillers, Helene Bonneau-Maynard

LIMSI/CNRS, France

In this paper, we describe the evaluation of the dialog management and response generation strategies being developed for retrieval of touristic information, selected as a common domain for the ARC-AUPELF-B2-action. Comparing and evaluating different strategies is a difficult task, which often remains unexplored, because in most cases evaluation approaches require a unified database structure and efficient integration of data from several disparate sources and forms. To avoid this problem, we implemented two dialog strategy versions within the same general platform. We investigate qualitative and quantitative criteria for evaluation of these dialog control strategies: in particular, by testing the efficiency of our system with and without automatic mechanisms for guiding the user via suggestive prompts. An evaluation phase has been carried out to assess the utility of guiding the user with 32 naive and experienced subjects. The experiments show that user guidance is appropriate for novices and appreciated by all users.

Full Paper

Bibliographic reference.  Devillers, Laurence / Bonneau-Maynard, Helene (1998): "Evaluation of dialog strategies for a tourist information retrieval system ", In ICSLP-1998, paper 0378.