Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Modality Integration and Dialog Management for a Robotic Assistant

Ioannis Toptsis, Axel Haasch, Sonja Hwel, Jannik Fritsch, Gernot A. Fink

Bielefeld University, Germany

The communication with robotic assistants or companions is a challenging new domain for the use of dialog systems. In contrast to classical spoken language interfaces users interact with mobile robots mostly in a multi-modal way. In this paper we will present the integration of several modalities in the dialog system of BIRON - the Bielefeld Robot Companion. Besides speech as the main modality the system integrates deictic gestures and visual scene information in order to resolve object references in a task oriented dialog. We will present example interactions with BIRON and first qualitative results from the "home-tour" scenario defined within the COGNIRON project.

Full Paper

Bibliographic reference.  Toptsis, Ioannis / Haasch, Axel / Hwel, Sonja / Fritsch, Jannik / Fink, Gernot A. (2005): "Modality integration and dialog management for a robotic assistant", In INTERSPEECH-2005, 837-840.