AVSP 2003 - International Conference on Audio-Visual Speech Processing

September 4-7, 2003
St. Jorioz, France

A Method for the Analysis and Measurement of Communicative Head Movements in Human Dialogues

Loredana Cerrato (1,3), Mustapha Skhiri (2,3)

(1) Dep. Speech, Music and Hearing, Royal Institute of Technology (KTH), Stockholm, Sweden
(2) Dep. of Computer and Information Science (IDA), Linköping, Sweden
(3) Swedish Graduate School of Language Technology (GSLT)

The aim of this study is twofold: explore how people use specific gestures to serve important dialogue functions and show evidence that it is possible to measure and quantify their extent. The paper focuses both on the presentation of the method used for the recording, coding and measurement of gestures and on the discussion on the obtained results.

Gestures, mainly head movements, were selected from naturally elicited dialogues ad-hoc recorded in lab-environment. The recordings consisted both of audio-video data and data measurements obtained with a motion tracking system.

Most of the analyzed head movements are produced to give feedback and the results show that it is possible to identify a specific pattern for a specific movement and that movements can be easily measured and their extent can be quantified. The results obtained with our method might eventually be implemented to improve the naturalness in animated talking heads.

Full Paper

Bibliographic reference.  Cerrato, Loredana / Skhiri, Mustapha (2003): "A method for the analysis and measurement of communicative head movements in human dialogues", In AVSP 2003, 251-256.