8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

An Open-Set Detection Evaluation Methodology Applied to Language and Emotion Recognition

David A. van Leeuwen, Khiet P. Truong

TNO Human Factors, The Netherlands

This paper introduces a detection methodology for recognition technologies in speech for which it is difficult to obtain an abundance of non-target classes. An example is language recognition, where we would like to be able to measure the detection capability of a single target language without confounding with the modeling capability of non-target languages. The evaluation framework is based on a cross validation scheme leaving the non-target class out of the allowed training material for the detector. The framework allows us to use Detection Error Tradeoff curves properly. As another application example we apply the evaluation scheme to emotion recognition in order to obtain single-emotion detection performance assessment.

Full Paper

Bibliographic reference.  Leeuwen, David A. van / Truong, Khiet P. (2007): "An open-set detection evaluation methodology applied to language and emotion recognition", In INTERSPEECH-2007, 338-341.