ISCA Archive Interspeech 2009
ISCA Archive Interspeech 2009

A human benchmark for language recognition

Rosemary Orr, David A. van Leeuwen

In this study, we explore a human benchmark in language recognition, for the purpose of comparing human performance to machine performance in the context of the NIST LRE 2007. Humans are categorised in terms of language proficiency, and performance is presented per proficiency. The main challenge in this work is the design of a test and application of a performance metric which allows a meaningful comparison of humans and machines. The main result of this work is that where subjects have lexical knowledge of a language, even at a low level, they perform as well as the state of the art in language recognition systems in 2007.


doi: 10.21437/Interspeech.2009-620

Cite as: Orr, R., Leeuwen, D.A.v. (2009) A human benchmark for language recognition. Proc. Interspeech 2009, 2175-2178, doi: 10.21437/Interspeech.2009-620

@inproceedings{orr09_interspeech,
  author={Rosemary Orr and David A. van Leeuwen},
  title={{A human benchmark for language recognition}},
  year=2009,
  booktitle={Proc. Interspeech 2009},
  pages={2175--2178},
  doi={10.21437/Interspeech.2009-620}
}