Speech and manual gesture coordination in a pointing task

Jelena Krivokapic, Mark Tiede, Martha Tyrone, Dolly Goldenberg


This study explores the coordination between manual pointing gestures and gestures of the vocal tract. Using a novel methodology that allows for concurrent collection of audio, kinematic body and speech articulator trajectories, we ask 1) which particular gesture (vowel gesture, consonant gesture, or tone gesture) the pointing gesture is coordinated with, and 2) with which landmarks the two gestures are coordinated (for example, whether the pointing gesture is coordinated to the speech gesture by the onset or maximum displacement). Preliminary results indicate coordination of the intonation gesture and the pointing gesture.


DOI: 10.21437/SpeechProsody.2016-255

Cite as

Krivokapic, J., Tiede, M., Tyrone, M., Goldenberg, D. (2016) Speech and manual gesture coordination in a pointing task. Proc. Speech Prosody 2016, 1240-1244.

Bibtex
@inproceedings{Krivokapic+2016,
author={Jelena Krivokapic and Mark Tiede and Martha Tyrone and Dolly Goldenberg},
title={Speech and manual gesture coordination in a pointing task},
year=2016,
booktitle={Speech Prosody 2016},
doi={10.21437/SpeechProsody.2016-255},
url={http://dx.doi.org/10.21437/SpeechProsody.2016-255},
pages={1240--1244}
}