Findings of the V ar D ial Evaluation Campaign 2023 (2023)

Abstract: This report presents the results of the shared tasks organized as part of the VarDial Evaluation Campaign 2023. The campaign is part of the tenth workshop on Natural Language Processing (NLP) for Similar Languages, Varieties and Dialects (VarDial), co-located with EACL 2023. Three separate shared tasks were included this year: Slot and intent detection for low-resource language varieties (SID4LR), Discriminating Between Similar Languages – True Labels (DSL-TL), and Discriminating Between Similar Languages – Speech (DSL-S). All three tasks were organized for the first time this year.

## introduction the workshop series on nlp for similar languages, varieties and dialects (vardial), traditionally co-located with international conferences, has reached its tenth edition. since the first edition, vardial has hosted shared tasks on various topics such as language and dialect identification, morphosyntactic tagging, question answering, and cross-lingual dependency parsing. the shared tasks have featured many languages and dialects from different families and data from various sources, genres, and domains @xcite @xcite @xcite @xcite @xcite . as part of the vardial evaluation campaign 2023, we offered three shared tasks which we present in this paper: this overview paper is structured as follows: in section 2, we briefly introduce the three shared tasks. section 3 presents the teams that submitted systems to the shared tasks. each task is then discussed in detail, focusing on the data, the participants' approaches, and the obtained results. section 4 is dedicated to sid4lr, section 5 to dsl-tl, and section 6 to dsl-s. the evaluation campaign took place in january -february 2023. due to the acl placing the workshop at the eacl conference in early may, the schedule from the shared tasks' first announcement to completion was relatively tight. the call for participation in the shared tasks was first published in early january, the training data sets for the shared tasks were released on january 23 rd , and the results were due to be submitted on february 27 th . 4 ## participating teams a total of six teams submitted runs to the sid4lr and dsl-tl tasks. two teams registered for the dsl-s shared task, but neither provided any submissions. in ## discriminating between similar languages -true labels the dsl-tl shared task contained two tracks: in addition to the two tracks mentioned above, we provided participants with the option of using external data sources (open submission) or only the dsl-tl dataset (closed submission). ## conclusion this paper presented an overview of the three shared tasks organized as part of the vardial evaluation campaign 2023: slot and intent detection for low-resource language varieties (sid4lr), discriminating between similar languages -true la-bels (dsl-tl), and discriminating between similar languages -speech (dsl-s).