Odyssey 2008: The Speaker and Language Recognition Workshop

Stellenbosch, South Africa
January 21-24, 2008

Detecting Nonnative Speech Using Speaker Recognition Approaches

Elizabeth Shriberg (1), Luciana Ferrer (2), Sachin Kajarekar (1), Nicolas Scheffer (1), Andreas Stolcke (1), Murat Akbacak (1)

(1) Speech Technology and Research Laboratory, SRI International, Menlo Park, CA, USA
(2) Department of Electrical Engineering, Stanford University, Stanford, CA, USA

Detecting whether a talker is speaking his native language is useful for speaker recognition, speech recognition, and intelligence applications. We study the problem of detecting nonnative speakers of American English, using two standard speech corpora. We apply approaches effective in speaker verification to this task, including systems based on MLLR, phone N-gram, prosodic, and word Ngram features. Results show equal error rates between 12% and 20%, depending on the system, test data, and choice of training data. Asymmetries in performance are most likely explained by differences in native language distributions in the corpora. Model combination yields substantial improvements over individual models, with the best result being around 8.6% EER. While phone Ngrams are widely used in related tasks (e.g., language and dialect ID), we find that it is the least effective model in combination; MLLR, prosody, and word N-gram systems play stronger roles. Overall, results suggest that individual systems and system combinations found useful for speaker ID also offer promise for nonnativeness detection, and that further efforts are warranted in this area.

Full Paper     Presentation (PDF)

Bibliographic reference.  Shriberg, Elizabeth / Ferrer, Luciana / Kajarekar, Sachin / Scheffer, Nicolas / Stolcke, Andreas / Akbacak, Murat (2008): "Detecting nonnative speech using speaker recognition approaches", In Odyssey-2008, paper 026.