10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

From Experiments to Articulatory Motion - A Three Dimensional Talking Head Model

Xiao Bo Lu (1), William Thorpe (1), Kylie Foster (2), Peter Hunter (1)

(1) University of Auckland, New Zealand
(2) University of Massey, New Zealand

The goal of this study is to develop a customised computer model that can accurately represent the motion of vocal articulators during vowels and consonants. Models of the articulators were constructed as Finite Element (FE) meshes based on digitised high-resolution MRI (Magnetic Resonance Imaging) scans obtained during quiet breathing. Articulatory kinematics during speaking were obtained by EMA (Electromagnetic Articulography) and video of the face. The movement information thus acquired was applied to the FE model to provide jaw motion, modeled as a rigid body, and tongue, cheek and lip movements modeled with a free-form deformation technique. The motion of the epiglottis has also been considered in the model.

Full Paper     Multimedia Files

Bibliographic reference.  Lu, Xiao Bo / Thorpe, William / Foster, Kylie / Hunter, Peter (2009): "From experiments to articulatory motion - a three dimensional talking head model", In INTERSPEECH-2009, 64-67.