International Conference on Auditory-Visual Speech Processing 2008

Tangalooma Wild Dolphin Resort, Moreton Island, Queensland, Australia
September 26-29, 2008

Linguistically Valid Movement Behavior Measured Non-Invasively

Adriano V. Barbosa (1), Hani C. Yehia (2), Eric Vatikiotis-Bateson (1)

(1) Department of Linguistics, University of British Columbia, Vancouver, Canada
(2) Department of Electronics, Federal University of Minas Gerais, Belo Horizonte, Brazil

We use optical flow to extract reliable kinematics from video for motions of the head, face, torso, and hands during speech and musical performance. Unlike dot- and marker- based measures, these markerless measures are non-invasive and require no a priori specification of measurement locations. Reliability is compared with marker tracking data and the methodís utility is demonstrated for data from Plains Cree, English, and Shona.

Full Paper

Bibliographic reference.  Barbosa, Adriano V. / Yehia, Hani C. / Vatikiotis-Bateson, Eric (2008): "Linguistically valid movement behavior measured non-invasively", In AVSP-2008, 173-177.