EUROSPEECH 2003 - INTERSPEECH 2003
There is a great potential for combining speech and gestures to improve human computer interaction because this kind of communication resembles more and more the natural communication humans use every day with each other. Therefore, this paper is about the multimodal interaction consisting of speech and gestures in an intelligent room. The advantages of using multimodal systems are explained and we present the gesture recognizer and the dialogue system we use. We explain how the information from the different modalities is parsed and integrated in one semantic representation.
Bibliographic reference. Gieselmann, Petra / Denecke, Matthias (2003): "Towards multimodal interaction with an intelligent room", In EUROSPEECH-2003, 2229-2232.