Auditory-Visual Speech Processing (AVSP'98)

December 4-6, 1998
Terrigal - Sydney, Australia

A New 3D Lip Model For Analysis and Synthesis Of Lip Motion In Speech Production

Lionel Reveret, Christian Benoît

ICP (Institut de la Communication Parlée), (France)

This work presents a methodology for 3D modeling of lip motion in speech production and its application to lip tracking and visual speech animation. Firstly, a geometric modeling allows to create a 3D lip model from 30 control points for any lip shape. Secondly, a statistical analysis, performed on a set of 10 key shapes, generates a lip gesture coding with three articulatory-oriented parameters, specific to one speaker. The choice of the key shapes is based on general phonetic observations. Finally, the application for lip tracking of the 3D model controlled by the three parameters is presented and evaluated.


Full Paper

Bibliographic reference.  Reveret, Lionel / Benoît, Christian (1998): "A new 3D lip model for analysis and synthesis of lip motion in speech production", In AVSP-1998, 207-212.

Multimedia Files

Link Original Filename Description Format
av98_207_1.mov (10224 KB) avsp36_1.mov.gz Lip tracking sequence focussed on the mouth Video File: QuickTime; 8 bits greyscale images, 291x201 pixels, 15 images per second
av98_207_2.mov (15245 KB) avsp36_2.mov.gz Lip tracking sequence with profile prediction from the face. Video File: QuickTime; 8 bits greyscale images, 291x201 pixels, 15 images per second