Automatic Dialect Detection in Arabic Broadcast Speech

Ahmed Ali, Najim Dehak, Patrick Cardinal, Sameer Khurana, Sree Harsha Yella, James Glass, Peter Bell, Steve Renals


In this paper, we investigate different approaches for dialect identification in Arabic broadcast speech. These methods are based on phonetic and lexical features obtained from a speech recognition system, and bottleneck features using the i-vector framework. We studied both generative and discriminative classifiers, and we combined these features using a multi-class Support Vector Machine (SVM). We validated our results on an Arabic/English language identification task, with an accuracy of 100%. We also evaluated these features in a binary classifier to discriminate between Modern Standard Arabic (MSA) and Dialectal Arabic, with an accuracy of 100%. We further reported results using the proposed methods to discriminate between the five most widely used dialects of Arabic: namely Egyptian, Gulf, Levantine, North African, and MSA, with an accuracy of 59.2%. We discuss dialect identification errors in the context of dialect code-switching between Dialectal Arabic and MSA, and compare the error pattern between manually labeled data, and the output from our classifier. All the data used on our experiments have been released to the public as a language identification corpus.


DOI: 10.21437/Interspeech.2016-1297

Cite as

Ali, A., Dehak, N., Cardinal, P., Khurana, S., Yella, S.H., Glass, J., Bell, P., Renals, S. (2016) Automatic Dialect Detection in Arabic Broadcast Speech. Proc. Interspeech 2016, 2934-2938.

Bibtex
@inproceedings{Ali+2016,
author={Ahmed Ali and Najim Dehak and Patrick Cardinal and Sameer Khurana and Sree Harsha Yella and James Glass and Peter Bell and Steve Renals},
title={Automatic Dialect Detection in Arabic Broadcast Speech},
year=2016,
booktitle={Interspeech 2016},
doi={10.21437/Interspeech.2016-1297},
url={http://dx.doi.org/10.21437/Interspeech.2016-1297},
pages={2934--2938}
}