- T. Solorio, Elizabeth Blair, Suraj Maharjan, Steven Bethard, Mona T. Diab, Mahmoud A. Ghoneim, A. Hawwari, F. Alghamdi, Julia Hirschberg, Alison Chang, Pascale Fung. 2014. Overview for the First Shared Task on Language Identification in Code-Switched Data. Abstract: We present an overview of the ﬁrst shared task on language identiﬁcation on code-switched data. The shared task included code-switched data from four language pairs: Modern Standard Arabic-Dialectal Arabic (MSA-DA), Mandarin-English (MAN-EN), Nepali-English (NEP-EN), and Spanish-English (SPA-EN). A total of seven teams participated in the task and submitted 42 system runs. The evaluation showed that language identiﬁcation at the token level is more difﬁcult when the languages present are closely related, as in the case of MSA-DA, where the prediction performance was the lowest among all language pairs. In contrast, the language pairs with the higest F-measure where SPA-EN and NEP-EN. The task made evident that language identiﬁcation in code-switched data is still far from solved and warrants further research.
