International Conference on Auditory-Visual Speech Processing 2008 Tangalooma Wild Dolphin Resort, Moreton Island, Queensland, Australia September 26-29, 2008

Linguistically Valid Movement Behavior Measured Non-Invasively

Adriano V. Barbosa (1), Hani C. Yehia (2), Eric Vatikiotis-Bateson (1)

(1) Department of Linguistics, University of British Columbia, Vancouver, Canada
(2) Department of Electronics, Federal University of Minas Gerais, Belo Horizonte, Brazil

We use optical flow to extract reliable kinematics from video for motions of the head, face, torso, and hands during speech and musical performance. Unlike dot- and marker- based measures, these markerless measures are non-invasive and require no a priori specification of measurement locations. Reliability is compared with marker tracking data and the method’s utility is demonstrated for data from Plains Cree, English, and Shona.

Full Paper

Bibliographic reference.  Barbosa, Adriano V. / Yehia, Hani C. / Vatikiotis-Bateson, Eric (2008): "Linguistically valid movement behavior measured non-invasively", In AVSP-2008, 173-177.