8th International Conference on Spoken Language Processing

Jeju Island, Korea
October 4-8, 2004

A Multi-Modal Dialog System for a Mobile Robot

Ioannis Toptsis, Shuyin Li, Britta Wrede, Gernot A. Fink

Bielefeld University, Germany

A challenging domain for dialog systems is their use for the communication with robotic assistants. In contrast to the classical use of spoken language for information retrieval, on a mobile robot multi-modal dialogs and the dynamic interaction of the robot system with its environment have to be considered. In this paper we will present the dialog system developed for BIRON - the Bielefeld Robot Companion. The system is able to handle multi-modal dialogs by augmenting semantic interpretation structures derived from speech with hypotheses for additional modalities as e.g. speech-accompanying gestures. The architecture of the system is modular with the dialog manager being the central component. In order to be aware of the dynamic behavior of the robot itself, the possible states of the robot control system are integrated into the dialog model. We will present example interactions with BIRON from the "home-tour" scenario defined within the COGNIRON project.

Full Paper

Bibliographic reference.  Toptsis, Ioannis / Li, Shuyin / Wrede, Britta / Fink, Gernot A. (2004): "A multi-modal dialog system for a mobile robot", In INTERSPEECH-2004, 273-276.