ISCA Archive AVSP 2003
ISCA Archive AVSP 2003

Low resource lip finding and tracking algorithm for embedded devices

Jesús F. Guitarte Pérez, Klaus Lukas, Alejandro F. Frangi

One of the best challenges in Lip Reading is to apply this technology in embedded devices. In current solutions the high use of resources, especially in reference to visual processing, makes the implementation and integration into a small device very difficult.

In this article a new and efficient algorithm for detection and tracking of lips is presented. Lip Finding and Tracking are customary first steps in visual processing for Lip Reading. In our approach Lips are found among a small number of blobs, which should fulfill geometric constraints. The proposed algorithm runs on an ARM920T embedded device using on average less than 4 MHz1 (2,7% of CPU load). This algorithm shows promising results in a realistic environment accomplishing successful lip finding and tracking in 94.2% of more than 4900 image frames.


Cite as: Guitarte Pérez, J.F., Lukas, K., Frangi, A.F. (2003) Low resource lip finding and tracking algorithm for embedded devices. Proc. Auditory-Visual Speech Processing, 111-116

@inproceedings{guitarteperez03_avsp,
  author={Jesús F. {Guitarte Pérez} and Klaus Lukas and Alejandro F. Frangi},
  title={{Low resource lip finding and tracking algorithm for embedded devices}},
  year=2003,
  booktitle={Proc. Auditory-Visual Speech Processing},
  pages={111--116}
}