Multi-Modal Dialogue in Mobile Environments (IDS-02)

June 17-19, 2002
Kloster Irsee, Germany

Turn-Taking Gestures and Hourglasses in a Multi-Modal Dialogue System

Jens Edlund and Magnus Nordstrand

Centre for Speech Technology, KTH, Stockholm, Sweden

An experiment with 24 subjects was performed. The subjects were split in three groups, and asked to extract information from the AdApt dialogue system for somewhat over 30 minutes per subject. The system configuration varied in that one group had turn-taking gestures from an animated talking head, another had an hourglass symbol to signal when the system was busy, and the third had no turn-taking feedback at all. The results show that although the hourglass setup showed no decrease in efficiency compared to the facial gestures, it made the subjects less satisfied. The lack of turn-taking feedback was noticed and mentioned by half of the subjects in that group.

Full Paper

Bibliographic reference.  Edlund, Jens / Nordstrand, Magnus (2002): "Turn-taking gestures and hourglasses in a multi-modal dialogue system", In IDS-2002, paper 31; 10 pp.