Auditory-Visual Speech Processing (AVSP'99) August 7-10, 1999 Santa Cruz, CA, USA

A Symbolic System for Multi-Purpose Description of the Mouth Shapes

Kazuya Imaizumi (1), Shizuo Hiki (1), Yumiko Fukuda (2)

(1) Graduate School of Human Sciences, Waseda University, Tokorozawa, Japan
(2) Research Institute, National Rehabilitation Center for the Disabled, Tokorozawa, Japan

A multi-purpose symbolic system which can describe all of the mouth shapes conveying various kinds of linguistic information in signing, speech dialogue, and speechreading is developed, taking account of the constraints of anatomical structure and neural control and the possibility of visual discrimination. In order to make the changes in the three-dimensional shape of lips, the changes are described by four scales, namely, upward and downward heights and lateralward width of the opening of the lips, and forward and backward depths of the corners and centers. Then, the space which is composed by those scales is divided into visually discriminable parts.

Full Paper

Bibliographic reference.  Imaizumi, Kazuya / Hiki, Shizuo / Fukuda, Yumiko (1999): "A symbolic system for multi-purpose description of the mouth shapes", In AVSP-1999, paper #24.