The 2012 NIST Speaker Recognition Evaluation was substantially different from the prior NIST speaker evaluations in its basic paradigm regarding system knowledge of most of the target speakers. This involved both a substantial increase in the amount of training data for most targets, and the provision of this data in advance of the evaluation with knowledge of these specific targets available to the system for all evaluation trials. We examine the performance effects of these changes, with contrasts provided by a limited number of targets with limited training not made known in advance and by one participant’s system designed not to take advantage of the prior knowledge of multiple targets.
Cite as: Martin, A.F., Greenberg, C.S., Howard, J.M., Doddington, G.R., Godfrey, J.J., Stanford, V.M. (2014) Effects of the New Testing Paradigm of the 2012 NIST Speaker Recognition Evaluation. Proc. The Speaker and Language Recognition Workshop (Odyssey 2014), 1-5, doi: 10.21437/Odyssey.2014-1
@inproceedings{martin14_odyssey,
author={Alvin F. Martin and Craig S. Greenberg and John M. Howard and George R. Doddington and John J. Godfrey and Vincent M. Stanford},
title={{Effects of the New Testing Paradigm of the 2012 NIST Speaker Recognition Evaluation}},
year=2014,
booktitle={Proc. The Speaker and Language Recognition Workshop (Odyssey 2014)},
pages={1--5},
doi={10.21437/Odyssey.2014-1}
}