7th International Conference on Spoken Language Processing

September 16-20, 2002
Denver, Colorado, USA

A Link Between Cepstral Shrinking and the Weighted Product Rule in Audio-Visual Speech Recognition

Simon Lucey, Sridha Sridharan, Vinod Chandran

Queensland University of Technology, Australia

The weighted product rule has been shown empirically to be of great benefit in audio-visual speech recognition (AVSR), for isolated word recognition tasks. A firm theoretical basis for the selection of effective weights is of considerable interest to the audio-visual speech processing community. In this paper a clear link is established between the selection of effective weightings and the approximately isotropic shrinkage that the distribution of acoustic cepstral features undergo in the presence of additive noise. An elucidation of the theoretical relationship between the cepstral shrinkage and the variance of the HMM audio log-likelihoods is then explored.


Full Paper

Bibliographic reference.  Lucey, Simon / Sridharan, Sridha / Chandran, Vinod (2002): "A link between cepstral shrinking and the weighted product rule in audio-visual speech recognition", In ICSLP-2002, 1961-1964.