2001: A Speaker Odyssey - The Speaker Recognition Workshop

June 18-22, 2001
Crete, Greece

Unsupervised Evaluation of Speaker Verification Systems

Niko Brümmer (1), Jason Pelecanos (2)

(1) DataVoice Systems, Stellenbosch, South Africa
(2) Speech Research Lab, Queensland University of Technology, Brisbane, Australia

A method for blind estimation of DET curves for speaker verification systems is proposed. Verification error probabilities are estimated on a database where speaker identities are unknown. The database must provide a set of impostor-only tests as well as a set of mixed impostor and target tests. This method is tested on 9 speaker verification systems that were scored on the NIST 2000 database. Good DET estimates are obtained for systems with low error rates, while poorer estimates are obtained for systems with high error rates.


Full Paper   Presentation

Bibliographic reference.  Brümmer, Niko / Pelecanos, Jason (2001): "Unsupervised evaluation of speaker verification systems", In ODYSSEY-2001, 243-248.