Auditory-Visual Speech Processing 2005

British Columbia, Canada
July 24-27, 2005

Computational Model of Some Communication Head Movements in a Speech Act

Sonia Sangari, Mustapha Skhiri, Bertil Lyberg

Department of Computer and Information Science, Linköping University, Sweden

Speech communication involves normally not only speech but also face and head movements. In the present investigation the visual correlates to focal accent and to confirmation in Swedish are studied and a computational model for the movements is hypothesized. The head movements are recorded with the Qualisys MacReflex motion tracking system simultaneously with the speech signal. The results confirm earlier results that the head movements that co-occur with the signalling of focal accent in the speech signal will have the extreme values at the primary stressed syllable of the word carrying focal accent independent of the word accent type in Swedish. The nodding that is signalling confirmation is signalled by means of a damped oscillation of the head. The head movements in both cases may be simulated by a second order linear system and the different patterns are two of the three possible solutions to the equations.

Full Paper

Bibliographic reference.  Sangari, Sonia / Skhiri, Mustapha / Lyberg, Bertil (2005): "Computational model of some communication head movements in a speech act", In AVSP-2005, 137-142.