AVSP 2003 - International Conference on Audio-Visual Speech Processing

September 4-7, 2003
St. Jorioz, France

Low Resource Lip Finding and Tracking Algorithm for Embedded Devices

Jesús F. Guitarte Pérez (1), Klaus Lukas (1), Alejandro F. Frangi (1)

(1) Siemens AG, Corporate Technology, Munich, Germany
(2) Computer Vision Group, Aragon Institute of Engineering Research, University of Zaragoza, Spain 112

One of the best challenges in Lip Reading is to apply this technology in embedded devices. In current solutions the high use of resources, especially in reference to visual processing, makes the implementation and integration into a small device very difficult.

In this article a new and efficient algorithm for detection and tracking of lips is presented. Lip Finding and Tracking are customary first steps in visual processing for Lip Reading. In our approach Lips are found among a small number of blobs, which should fulfill geometric constraints. The proposed algorithm runs on an ARM920T embedded device using on average less than 4 MHz1 (2,7% of CPU load). This algorithm shows promising results in a realistic environment accomplishing successful lip finding and tracking in 94.2% of more than 4900 image frames.

Full Paper

Bibliographic reference.  Guitarte Pérez, Jesús F. / Lukas, Klaus / Frangi, Alejandro F. (2003): "Low resource lip finding and tracking algorithm for embedded devices", In AVSP 2003, 111-116.