5th International Conference on Spoken Language Processing

Sydney, Australia
November 30 - December 4, 1998

Missing Data Reconstruction for Robust Automatic Speech Recognition in the Framework of Hybrid HMM/ANN Systems

Stéphane Dupont

Faculte Polytechnique de Mons (FPMs), Belgium

In this paper, we propose to use the missing data theory to allow the reconstruction of missing spectro-temporal parameters in the framework of hybrid HMM/ANN systems. A simple signal-to-noise ratio estimator is used to automatically detect the components that are unavailable or corrupted by noise (missing components). A limited number of multidimensional gaussian distributions are then used to reconstruct those missing components solely on the basis of the present data. The reconstructed vectors are then used as input to an artificial neural network estimating the HMM state probabilities. Continuous speech recognition experiments have been done on filtered speech. In this case, filtered components carry few or no information at all, and hence, should probably be ignored. The results presented in this paper illustrate this point of view. Complementary experiments also suggest the interest of the proposed approach in the case of noisy speech.

Full Paper

Bibliographic reference.  Dupont, Stéphane (1998): "Missing data reconstruction for robust automatic speech recognition in the framework of hybrid HMM/ANN systems", In ICSLP-1998, paper 0581.