COST278 and ISCA Tutorial and Research Workshop (ITRW) on Robustness Issues in Conversational Interaction University of East Anglia, Norwich, UK August 30-31, 2004

Formant Prediction from MFCC Vectors

Jonathan Darch, Ben Milner, Xu Shao

chool of Computing Sciences, University of East Anglia, Norwich, UK

This work proposes a novel method of predicting formant frequencies from a stream of mel-frequency cepstral coefficients (MFCC) feature vectors. Prediction is based on modelling the joint density of MFCC vectors and formant vectors using a Gaussian mixture model (GMM). Using this GMM and an input MFCC vector, two maximum a posteriori (MAP) prediction methods are developed. The first method predicts formants from the closest, in some sense, cluster to the input MFCC vector, while the second method takes a weighted contribution of formants from all clusters. Experimental results are presented using the ETSI Aurora connected digit database and show that the predicted formant frequency is within 3.25% of the reference formant frequency, as measured from hand-corrected formant tracks.

Full Paper

Bibliographic reference.  Darch, Jonathan / Milner, Ben / Shao, Xu (2004): "Formant prediction from MFCC vectors", In Robust2004, paper 40.