Multi-Modal Dialogue in Mobile Environments (IDS-02) June 17-19, 2002 Kloster Irsee, Germany

Constraint Manipulation and Visualization in a Multimodal Dialogue System

Joakim Gustafson (1,2), Linda Bell (1,2), Johan Boye (1), Jens Edlund (2) and Mats Wirén (1)

(1) Telia Research, Farsta, Sweden
(2) Centre for Speech Technology, KTH, Stockholm, Sweden

When interacting with spoken and multimodal dialogue systems, it is often difficult for users to understand and influence how their input is processed by the system. In this paper, we describe how these problems were addressed in the multimodal real-estate dialogue system AdApt. During the course of a dialogue, the user's contraints are translated into symbolic icons that are visualized on the screen and can be manipulated by drag-and-drop operations. Users are thus given a clear picture of how their utterances are understood, and are given a transparent means of controlling the interaction with the system.

Full Paper

Bibliographic reference.  Gustafson, Joakim / Bell, Linda / Boye, Johan / Edlund, Jens / Wirén, Mats (2002): "Constraint manipulation and visualization in a multimodal dialogue system", In IDS-2002, paper 15; 15 pp.