Sixth International Conference on Spoken Language Processing
(ICSLP 2000)

Beijing, China
October 16-20, 2000

Towards Robust Lipreading

Wen Gao (1,2), Jiyong Ma (1,2), Rui Wang (2), Hongxun Yao (2)

(1) Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
(2) Department of Computer Science, Harbin Institute of Technology, Harbin, China

In this paper, a robust and fast approach to lip detecting and lip-reading is presented. The approach combines the information of lip color with the geometrical features of lips in human face. This technique makes it possible to derive lip regions in real time under regular illumination conditions. The experimental results with more than 2000 images have shown that the approach to locating lips is very efficient both in locating speed and locating accuracy. Recognition tests were conducted on Chinese phrases. The approach achieved an ccuracy of 90% for speaker dependent recognition task.

Full Paper

Bibliographic reference.  Gao, Wen / Ma, Jiyong / Wang, Rui / Yao, Hongxun (2000): "Towards robust lipreading", In ICSLP-2000, vol.3, 15-19.