ISCA Archive AVSP 2013
ISCA Archive AVSP 2013

Visual front-endwars: Viola-Jones face detector vs Fourier Lucas-Kanade

Shahram Kalantari, Rajitha Navarathna, David Dean, Sridha Sridharan

The performance of visual speech recognition (VSR) systems are significantly influenced by the accuracy of the visual front-end. The current state-of-the-art VSR systems use off-the-shelf face detectors such as Viola- Jones (VJ) which has limited reliability for changes in illumination and head poses. For a VSR system to perform well under these conditions, an accurate visual front end is required. This is an important problem to be solved in many practical implementations of audio visual speech recognition systems, for example in automotive environments for an efficient human-vehicle computer interface. In this paper, we re-examine the current state-of-the-art VSR by comparing off-the-shelf face detectors with the recently developed Fourier Lucas-Kanade (FLK) image alignment technique. A variety of image alignment and visual speech recognition experiments are performed on a clean dataset as well as with a challenging automotive audio-visual speech dataset. Our results indicate that the FLK image alignment technique can significantly outperform off-the shelf face detectors, but requires frequent fine-tuning.

Index Terms: Visual Front-ends, Viola-Jones, Fourier Lucas-Kanade, Visual Speech Recognition

Cite as: Kalantari, S., Navarathna, R., Dean, D., Sridharan, S. (2013) Visual front-endwars: Viola-Jones face detector vs Fourier Lucas-Kanade. Proc. Auditory-Visual Speech Processing, 163-168

  author={Shahram Kalantari and Rajitha Navarathna and David Dean and Sridha Sridharan},
  title={{Visual front-endwars: Viola-Jones face detector vs Fourier Lucas-Kanade}},
  booktitle={Proc. Auditory-Visual Speech Processing},