ISCA Archive Odyssey 2001
ISCA Archive Odyssey 2001

Unsupervised evaluation of speaker verification systems

Niko Brümmer, Jason Pelecanos

A method for blind estimation of DET curves for speaker verification systems is proposed. Verification error probabilities are estimated on a database where speaker identities are unknown. The database must provide a set of impostor-only tests as well as a set of mixed impostor and target tests. This method is tested on 9 speaker verification systems that were scored on the NIST 2000 database. Good DET estimates are obtained for systems with low error rates, while poorer estimates are obtained for systems with high error rates.


Cite as: Brümmer, N., Pelecanos, J. (2001) Unsupervised evaluation of speaker verification systems. Proc. The Speaker and Language Recognition Workshop (Odyssey 2001), 243-248

@inproceedings{brummer01_odyssey,
  author={Niko Brümmer and Jason Pelecanos},
  title={{Unsupervised evaluation of speaker verification systems}},
  year=2001,
  booktitle={Proc. The Speaker and Language Recognition Workshop (Odyssey 2001)},
  pages={243--248}
}