ISCA Archive Eurospeech 1999
ISCA Archive Eurospeech 1999

Evaluation of confidence measures for language identification

Kay Berkling, Douglas A. Reynolds, Marc Zissman

In this paper we examine various ways to derive confidence measures for a language identification system [3], using phone recognition followed by language models, and describe the application of an evaluation metric [1] for measuring the “goodness" of the different confidence measures. Experiments are conducted on the 1996 NIST Language Identification Evaluation corpus (derived from the Callfriend corpus of conversational telephone speech). The system is trained on the NIST 96 development data and evaluated on the NIST 96 evaluation data. Results indicate that we are able to predict the performance of a system and quantitatively evaluate how well the prediction holds on new data.


doi: 10.21437/Eurospeech.1999-94

Cite as: Berkling, K., Reynolds, D.A., Zissman, M. (1999) Evaluation of confidence measures for language identification. Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999), 363-366, doi: 10.21437/Eurospeech.1999-94

@inproceedings{berkling99_eurospeech,
  author={Kay Berkling and Douglas A. Reynolds and Marc Zissman},
  title={{Evaluation of confidence measures for language identification}},
  year=1999,
  booktitle={Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999)},
  pages={363--366},
  doi={10.21437/Eurospeech.1999-94}
}