balhafni commited on
Commit
ce88d39
1 Parent(s): b8837f4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -3
README.md CHANGED
@@ -1,3 +1,40 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - ar
5
+ ---
6
+
7
+
8
+ # AraT5 CODAfication Model
9
+
10
+ ## Model description
11
+ **AraT5 CODAfication** is a text normalization model that normalizes dialectal Arabic text into the Conventional Orthography for Dialectal Arabic (CODA).
12
+ The model was built by fine-tuning [AraT5-v2](https://huggingface.co/UBC-NLP/AraT5v2-base-1024) on the [MADAR CODA](https://camel.abudhabi.nyu.edu/madar-coda-corpus/) dataset.
13
+ Our fine-tuning procedure and the hyperparameters we used can be found in our paper *"[Exploiting Dialect Identification
14
+ in Automatic Dialectal Text Normalization](https://arxiv.org/abs/2407.03020)."* Our fine-tuning code and data can be found [here](https://github.com/CAMeL-Lab/codafication).
15
+
16
+
17
+ ## Intended uses
18
+ You can use the **AraT5** CODAfication model as part of Hugging Face's transformers >= 4.22.2.
19
+
20
+ ## How to use
21
+
22
+
23
+ ## Citation
24
+ ```bibtex
25
+ @inproceedings{alhafni-etal-2024-exploiting,
26
+ title = "Exploiting Dialect Identification in Automatic Dialectal Text Normalization",
27
+ author = "Alhafni, Bashar and
28
+ Al-Towaity, Sarah and
29
+ Fawzy, Ziyad and
30
+ Nassar, Fatema and
31
+ Eryani, Fadhl and
32
+ Bouamor, Houda and
33
+ Habash, Nizar",
34
+ booktitle = "Proceedings of ArabicNLP 2024"
35
+ month = "aug",
36
+ year = "2024",
37
+ address = "Bangkok, Thailand",
38
+ abstract = "Dialectal Arabic is the primary spoken language used by native Arabic speakers in daily communication. The rise of social media platforms has notably expanded its use as a written language. However, Arabic dialects do not have standard orthographies. This, combined with the inherent noise in user-generated content on social media, presents a major challenge to NLP applications dealing with Dialectal Arabic. In this paper, we explore and report on the task of CODAfication, which aims to normalize Dialectal Arabic into the Conventional Orthography for Dialectal Arabic (CODA). We work with a unique parallel corpus of multiple Arabic dialects focusing on five major city dialects. We benchmark newly developed pretrained sequence-to-sequence models on the task of CODAfication. We further show that using dialect identification information improves the performance across all dialects. We make our code, data, and pretrained models publicly available.",
39
+ }
40
+ ```