7th International Conference on Spoken Language Processing

September 16-20, 2002
Denver, Colorado, USA

Flexible Multimodal Human-Machine Interaction in Mobile Environments

Dirk Bühler (1), Wolfgang Minker (1), Jochen Häußler (2), Sven Krüger (2)

(1) DaimlerChrysler - Research and Technology, Germany; (2) European Media Lab, Germany

This article describes a prototype system for multimodal humanmachine interaction in mobile environments that is being developed within the German national SmartKom research project. The system is novel in that it a) aims at combining the flexibility of state-of-theart handheld digital devices with the computing power of standard PC machinery, and b) connects two substantially different mobile environments, namely pedestrian and car driver.

Motivated by the specific safety and privacy considerations and requirements in both environments, we present a framework for flexible modality control. A characteristic feature of our framework is the insight that both user and system may independently and asynchronously initiate a modality transition. We conclude with a brief discussion of further issues and research questions.

Full Paper

Bibliographic reference.  Bühler, Dirk / Minker, Wolfgang / Häußler, Jochen / Krüger, Sven (2002): "Flexible multimodal human-machine interaction in mobile environments", In ICSLP-2002, 169-172.