5th International Conference on Spoken Language Processing

Sydney, Australia
November 30 - December 4, 1998

Confidence Measures Derived from an Acceptor HMM

Gethin Williams, Steve Renals

University of Sheffield, UK

In this paper we define a number of confidence measures derived from an acceptor HMM and evaluate their performance for the task of utterance verification using the North American Business News (NAB) and Broadcast News (BN) corpora. Results are presented for decodings made at both the word and phone level which show the relative profitability of rejection provided by the diverse set of confidence measures. The results indicate that language model dependent confidence measures have reduced performance on BN data relative to that for the more grammatically constrained NAB data. An explanation linking the observations that rejection is more profitable for noisy acoustics, for a reduced vocabulary and at the phone level is also given.

Full Paper

Bibliographic reference.  Williams, Gethin / Renals, Steve (1998): "Confidence measures derived from an acceptor HMM", In ICSLP-1998, paper 0644.