EUROSPEECH 2003 - INTERSPEECH 2003 8th European Conference on Speech Communication and Technology Geneva, Switzerland September 1-4, 2003

Towards Multimodal Interaction with an Intelligent Room

Petra Gieselmann (1), Matthias Denecke (2)

(1) Universität Karlsruhe, Germany
(2) Carnegie Mellon University, USA

There is a great potential for combining speech and gestures to improve human computer interaction because this kind of communication resembles more and more the natural communication humans use every day with each other. Therefore, this paper is about the multimodal interaction consisting of speech and gestures in an intelligent room. The advantages of using multimodal systems are explained and we present the gesture recognizer and the dialogue system we use. We explain how the information from the different modalities is parsed and integrated in one semantic representation.

Full Paper

Bibliographic reference.  Gieselmann, Petra / Denecke, Matthias (2003): "Towards multimodal interaction with an intelligent room", In EUROSPEECH-2003, 2229-2232.