10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Overall Performance Metrics for Multi-Condition Speaker Recognition Evaluations

David A. van Leeuwen

TNO Human Factors, The Netherlands

In this paper we propose a framework for measuring the overall performance of an automatic speaker recognition system using a set of trials of a heterogeneous evaluation such as NIST SRE-2008, which combines several acoustic conditions in one evaluation. We do this by weighting trials of different conditions according to their relative proportion, and we derive expressions for the basic speaker recognition performance measures Cdet, Cllr, as well as the DET curve, from which EER and Cmindet can be computed. Examples of pooling of conditions are shown on SRE-2008 data, including speaker sex and microphone type and speaking style.

Full Paper

Bibliographic reference.  Leeuwen, David A. van (2009): "Overall performance metrics for multi-condition speaker recognition evaluations", In INTERSPEECH-2009, 908-911.