ESCA Workshop on Interactive Dialogue in Multi-Modal Systems (IDS-99) June 22-25, 1999 Kloster Irsee, Germany

Reference Problems in Chameleon

Tom Brøndsted

Center for PersonKommunikation, Aalborg University, Denmark

This paper discusses the problem of endophoric/deictic references in multimodal dialogues involving speech and pointing gestures. The dialogue system in focus is a building information system implemented using a general workbench architecture "Chameleon". Chameleon and the building information system have been developed within the IntelliMedia 2000+ project initiated 1996 by the Institute of Electronic Systems, Aalborg University [1]. Further development and experiments were carried out in the EU Esprit-project 24 493 "Language and Image Data Fusion using Stochastic Models and Spatial Context Modeling" together with LIMSI and Bertin (coordinator), France [2]. We focus on two problems (1) cross-media references and (2) crossuser/system references.

References

1. T. Brøndsted, P. Dalsgaard, L.B. Larsen, M. Manthey, P. McKevitt, T.B. Moeslund, K.G. Olesen: A platform for developing Intelligent MultiMedia Applications. Technical Report R-98- 1004. Center for PersonKommunikation, Aalborg University, May, 1998.
2. A. Braffort, T. Brøndsted, P. Dalsgaard, R. Gherbi, P. McKevitt, J. Patureu: CHAMELEON. Language and Image Data Fusion using Stochastic Models and Spatial Context Modelling. Esprit Project 24 493. Deliverable D1-D3. Nancy December, 1997/98.

Full Paper

Bibliographic reference.  Brøndsted, Tom (1999): "Reference problems in Chameleon", In IDS-99, 133-136.