Sixth International Conference on Spoken Language Processing
(ICSLP 2000)

Beijing, China
October 16-20, 2000

Turn Taking and Multimodal Information in Two-People Dialog

Keiko Watanuki, Susumu Seki, Hideo Miyoshi

Real World Computing Partnership, Multimodal Functions Sharp Laboratories in System Technology Development Center, Sharp Corporation, Chiba, Japan

This research focuses on the relationship between turntaking and intensity of motions (head, hand and upper body motions). We examine five spontaneous dialogues conducted in Japanese, which were collected using video and audio recording equipment, and optical motion sensing device. We show first that the motions appear more in speech duration than in pause. Next, we present some data showing that motions of chest and hand are more relevant to turn hold, and that motions of head do not have a signal function for differentiating the turn hold form the turn change.

Full Paper

Bibliographic reference.  Watanuki, Keiko / Seki, Susumu / Miyoshi, Hideo (2000): "Turn taking and multimodal information in two-people dialog", In ICSLP-2000, vol.1, 657-660.