Multi-Modal Dialogue in Mobile Environments (IDS-02) June 17-19, 2002 Kloster Irsee, Germany

The Smartkom Mobile Multi-Modal Dialogue System

Dirk Bühler (1), Wolfgang Minker (1), Jochen Häußler (2), and Sven Krüger (2)

(1) DaimlerChrysler Research and Technology, Ulm, Germany
(2) European Media Lab, Heidelberg, Germany

This article describes requirements and a prototype system for a flexible multimodal human-machine interaction in two substantially different mobile environments, namely pedestrian and car. The system allows an integrated trip planning using multi-modal input and output. Motivated by the specific safety and privacy requirements in both environments, we present a framework for flexible modality control. A characteristic feature of our framework is the insight that both user and system may independently and asynchronously initiate a modality transition. We conclude with a brief discussion of further issues and research questions.

Full Paper

Bibliographic reference.  Bühler, Dirk / Minker, Wolfgang / Häußler, Jochen / Krüger, Sven (2002): "The Smartkom mobile multi-modal dialogue system", In IDS-2002, paper 2; 11 pp.