ISCA Archive Interspeech 2013
ISCA Archive Interspeech 2013

Analysis of gaze and speech patterns in three-party quiz game interaction

Samer Al Moubayed, Jens Edlund, Joakim Gustafson

In order to understand and model the dynamics between interaction phenomena such as gaze and speech in face-to-face multiparty interaction between humans, we need large quantities of reliable, objective data of such interactions. To date, this type of data is in short supply. We present a data collection setup using automated, objective techniques in which we capture the gaze and speech patterns of triads deeply engaged in a high-stakes quiz game. The resulting corpus consists of five one-hour recordings, and is unique in that it makes use of three state-of-the-art gaze trackers (one per subject) in combination with a state-of-the-art conical microphone array designed to capture roundtable meetings. Several video channels are also included. In this paper we present the obstacles we encountered and the possibilities afforded by a synchronised, reliable combination of large-scale multi-party speech and gaze data, and an overview of the first analyses of the data.


doi: 10.21437/Interspeech.2013-302

Cite as: Moubayed, S.A., Edlund, J., Gustafson, J. (2013) Analysis of gaze and speech patterns in three-party quiz game interaction. Proc. Interspeech 2013, 1126-1130, doi: 10.21437/Interspeech.2013-302

@inproceedings{moubayed13_interspeech,
  author={Samer Al Moubayed and Jens Edlund and Joakim Gustafson},
  title={{Analysis of gaze and speech patterns in three-party quiz game interaction}},
  year=2013,
  booktitle={Proc. Interspeech 2013},
  pages={1126--1130},
  doi={10.21437/Interspeech.2013-302}
}