7th International Conference on Spoken Language Processing

September 16-20, 2002
Denver, Colorado, USA

Coordination of Referring Expressions in Multimodal Human-Computer Dialogue

Gabriel Skantze

KTH, Sweden

This study examines coordination of referring expressions in multimodal human-computer dialogue, i.e. to what extent usersí choices of referring expressions are affected by the referring expressions that the system is designed to use. An experiment was conducted, using a semi-automatic multimodal dialogue system for apartment seeking. The user and the system could refer to areas and apartments on an interactive map by means of speech and pointing gestures. Results indicate that the referring expressions of the system have great influence on the userís choice of referring expressions, both in terms of modality and linguistic content. From this follows a number of implications for the design of multimodal dialogue systems.


Full Paper

Bibliographic reference.  Skantze, Gabriel (2002): "Coordination of referring expressions in multimodal human-computer dialogue", In ICSLP-2002, 553-556.