ISCA Archive Odyssey 2014
ISCA Archive Odyssey 2014

NIST Language Recognition Evaluation - Past and Future

Alvin F. Martin, Craig S. Greenberg, John M. Howard, George R. Doddington, John J. Godfrey

This is a review of the six NIST Language Recognitions Evaluations from 1996 to 2011. The evolving nature of the task is described, including the (non-)distinction between language and dialect. The languages/dialects tested are noted, and the challenges of data collection for such evaluations and the collections actually undertaken are reviewed. The performance measures employed are defined, and the performance levels achieved in both earlier and later evaluation tasks on different tests are discussed. Plans for the next evaluation in the series are presented.


doi: 10.21437/Odyssey.2014-23

Cite as: Martin, A.F., Greenberg, C.S., Howard, J.M., Doddington, G.R., Godfrey, J.J. (2014) NIST Language Recognition Evaluation - Past and Future. Proc. The Speaker and Language Recognition Workshop (Odyssey 2014), 145-151, doi: 10.21437/Odyssey.2014-23

@inproceedings{martin14b_odyssey,
  author={Alvin F. Martin and Craig S. Greenberg and John M. Howard and George R. Doddington and John J. Godfrey},
  title={{NIST Language Recognition Evaluation - Past and Future}},
  year=2014,
  booktitle={Proc. The Speaker and Language Recognition Workshop (Odyssey 2014)},
  pages={145--151},
  doi={10.21437/Odyssey.2014-23}
}