Second VENACO Workshop
The Structure of Multimodal Dialogue

Acquafredda di Maratea, Italy
September 16-20, 1991

Multimodal Interaction: Event Management and Experiments with ICPdraw

Jean Caelen

ICP-INPG, Grenoble, France

ICPdraw is a multimodal drawing application. Using the paradigm of "direct object manipulation" (by speech and 2D mouse gestures), several commands, such as "draw red triangle", "delete that" (while pointing to a deletable object), "move the blue circle upon the triangle", etc.s can be executed at the same time. In this kind of task, there are a number of problems related to the interface conception and the dialogue management: (1) event representation and management (in time, duration, etc.), (2) command interpretation with regard to the composition of events (in particular for the problem of spatial designation and coreference).

Full Paper

Bibliographic reference.  Caelen, Jean (1991): "Multimodal interaction: event management and experiments with ICPdraw", In SMMD-1991, 173-174.