8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Pointing to a Target While Naming It with /pata/ or /tapa/: The Effect of Consonants and Stress Position on Jaw-Finger Coordination

Amélie Rochet-Capellan (1), Jean-Luc Schwartz (1), Rafael Laboissière (2), Arturo Galvàn (2)

(1) ICP, France
(2) MPI CBS, Germany

This study investigates jaw-finger coordination in a task consisting in pointing to a target while naming it with a /pata/ or a /tapa/ utterance stressed either on the first ('CVCV) or on the second (CV'CV) syllable. Optotrack measurements of jaw and finger displacements show that for 'CVCV names, the moment at with the finger reaches the target alignment is synchronized with the maximum of the first jaw opening motion. For CV'CV names, the synchronization occurs between the moment at which the finger leaves the target-alignment position and the maximum of the jaw opening motion for the second vowel. This pattern of synchronization does not depend on the target position or on the consonants order. These results add some support to theories involving the coordination of orofacial and brachiomanual gestures in the development and phylogeny of human languages. They call for more investigations on the link between speech and brachiomanual gestures in face-to-face communication.

Full Paper

Bibliographic reference.  Rochet-Capellan, Amélie / Schwartz, Jean-Luc / Laboissière, Rafael / Galvàn, Arturo (2007): "Pointing to a target while naming it with /pata/ or /tapa/: the effect of consonants and stress position on jaw-finger coordination", In INTERSPEECH-2007, 634-637.