8th European Conference on Speech Communication and Technology

Geneva, Switzerland
September 1-4, 2003


Towards Multimodal Interaction with an Intelligent Room

Petra Gieselmann (1), Matthias Denecke (2)

(1) Universitšt Karlsruhe, Germany
(2) Carnegie Mellon University, USA

There is a great potential for combining speech and gestures to improve human computer interaction because this kind of communication resembles more and more the natural communication humans use every day with each other. Therefore, this paper is about the multimodal interaction consisting of speech and gestures in an intelligent room. The advantages of using multimodal systems are explained and we present the gesture recognizer and the dialogue system we use. We explain how the information from the different modalities is parsed and integrated in one semantic representation.

Full Paper

Bibliographic reference.  Gieselmann, Petra / Denecke, Matthias (2003): "Towards multimodal interaction with an intelligent room", In EUROSPEECH-2003, 2229-2232.