Sixth European Conference on Speech Communication and Technology

This paper proposes a method of predicting accuracy of keyword spotting in terms of FA count and spotting score of correct detections. A new measure F for predicting the FA count is calculated by simulation of the keyword spotting for phoneme sequences that phonemebased language model generates. Another measure C for predicting the spotting score of correct detections is obtained from a product of correct recognition probabilities of phonemes. Both correlation coeficients and prediction errors are used to evaluate these measures in comparison with a simple measure of the keyword phoneme length, L. The prediction errors of FA count based on L was 7.71. The measure F reduced the prediction errors by 16%, and it had stronger correlation with the FA count. Furthermore a combined measure of F and L reduced the errors by 23%. On the other hand, L was more effective to predict the spotting score of correct detections than the measure C.
Full Paper (PDF) GnuZipped Postscript
Bibliographic reference. Yamashita, Yoichi (1999): "Prediction of keyword spotting accuracy based on simulation", In EUROSPEECH'99, 12351238.