The communication with robotic assistants or companions is a challenging new domain for the use of dialog systems. In contrast to classical spoken language interfaces users interact with mobile robots mostly in a multi-modal way. In this paper we will present the integration of several modalities in the dialog system of BIRON - the Bielefeld Robot Companion. Besides speech as the main modality the system integrates deictic gestures and visual scene information in order to resolve object references in a task oriented dialog. We will present example interactions with BIRON and first qualitative results from the "home-tour" scenario defined within the COGNIRON project.
Cite as: Toptsis, I., Haasch, A., Hüwel, S., Fritsch, J., Fink, G.A. (2005) Modality integration and dialog management for a robotic assistant. Proc. Interspeech 2005, 837-840, doi: 10.21437/Interspeech.2005-387
@inproceedings{toptsis05_interspeech,
author={Ioannis Toptsis and Axel Haasch and Sonja Hüwel and Jannik Fritsch and Gernot A. Fink},
title={{Modality integration and dialog management for a robotic assistant}},
year=2005,
booktitle={Proc. Interspeech 2005},
pages={837--840},
doi={10.21437/Interspeech.2005-387}
}