Auditory-Visual Speech Processing (AVSP'98)
December 4-6, 1998
This work presents a methodology for 3D modeling of lip motion in speech production and its application to lip tracking and visual speech animation. Firstly, a geometric modeling allows to create a 3D lip model from 30 control points for any lip shape. Secondly, a statistical analysis, performed on a set of 10 key shapes, generates a lip gesture coding with three articulatory-oriented parameters, specific to one speaker. The choice of the key shapes is based on general phonetic observations. Finally, the application for lip tracking of the 3D model controlled by the three parameters is presented and evaluated.
Bibliographic reference. Reveret, Lionel / Benoît, Christian (1998): "A new 3D lip model for analysis and synthesis of lip motion in speech production", In AVSP-1998, 207-212.
|av98_207_1.mov (10224 KB)||avsp36_1.mov.gz||Lip tracking sequence focussed on the mouth||Video File: QuickTime; 8 bits greyscale images, 291x201 pixels, 15 images per second|
|av98_207_2.mov (15245 KB)||avsp36_2.mov.gz||Lip tracking sequence with profile prediction from the face.||Video File: QuickTime; 8 bits greyscale images, 291x201 pixels, 15 images per second|