ISCA Archive Interspeech 2005
ISCA Archive Interspeech 2005

Modality integration and dialog management for a robotic assistant

Ioannis Toptsis, Axel Haasch, Sonja Hüwel, Jannik Fritsch, Gernot A. Fink

The communication with robotic assistants or companions is a challenging new domain for the use of dialog systems. In contrast to classical spoken language interfaces users interact with mobile robots mostly in a multi-modal way. In this paper we will present the integration of several modalities in the dialog system of BIRON - the Bielefeld Robot Companion. Besides speech as the main modality the system integrates deictic gestures and visual scene information in order to resolve object references in a task oriented dialog. We will present example interactions with BIRON and first qualitative results from the "home-tour" scenario defined within the COGNIRON project.

doi: 10.21437/Interspeech.2005-387

Cite as: Toptsis, I., Haasch, A., Hüwel, S., Fritsch, J., Fink, G.A. (2005) Modality integration and dialog management for a robotic assistant. Proc. Interspeech 2005, 837-840, doi: 10.21437/Interspeech.2005-387

  author={Ioannis Toptsis and Axel Haasch and Sonja Hüwel and Jannik Fritsch and Gernot A. Fink},
  title={{Modality integration and dialog management for a robotic assistant}},
  booktitle={Proc. Interspeech 2005},