Promoted in part by its use in the Interspeech Challenges in 2009-2012, Average Recall has emerged as an attractive evaluation measure of classifier performance where the data has a skewed class distribution. In this paper, we show that importance weighting can be used to directly optimize Average Recall. We compare this approach to sampling techniques that have been previously used to classify skewed data. We demonstrate the use of this approach on the Interspeech 2009 Emotion Challenge tasks, and prosodic analysis tasks.
Index Terms: skewed class distributions, prosody, prosodic analysis, emotion classification.
Bibliographic reference. Rosenberg, Andrew (2012): "Classifying skewed data: importance weighting to optimize average recall", In INTERSPEECH-2012, 2242-2245.