monsoon-nlp commited on
Commit
5d73e61
1 Parent(s): 2dfd242

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -5
README.md CHANGED
@@ -11,11 +11,6 @@ from AUB MIND Lab.
11
  This model was then finetuned on dialect datasets from Qatar University, University of British Columbia / NLP,
12
  and Johns Hopkins University / LREC for 10 epochs.
13
 
14
- Sources
15
- - https://qspace.qu.edu.qa/handle/10576/15265
16
- - https://github.com/UBC-NLP/aoc_id
17
- - https://github.com/ryancotterell/arabic_dialect_annotation
18
-
19
  You can use special tokens to prompt five dialects: `[EGYPTIAN]`, `[GULF]`, `[LEVANTINE]`, `[MAGHREBI]`, or `[MSA]`, followed by a space.
20
 
21
  ```
@@ -34,3 +29,23 @@ Original model: https://huggingface.co/aubmindlab/aragpt2-medium
34
  I inserted new tokens into the tokenizer, finetuned the model on the dialect samples, and exported the new model.
35
 
36
  Notebook: https://colab.research.google.com/drive/19C0zbkSCt5ncVCa4kY-ik9hSEiJcjI-F
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  This model was then finetuned on dialect datasets from Qatar University, University of British Columbia / NLP,
12
  and Johns Hopkins University / LREC for 10 epochs.
13
 
 
 
 
 
 
14
  You can use special tokens to prompt five dialects: `[EGYPTIAN]`, `[GULF]`, `[LEVANTINE]`, `[MAGHREBI]`, or `[MSA]`, followed by a space.
15
 
16
  ```
 
29
  I inserted new tokens into the tokenizer, finetuned the model on the dialect samples, and exported the new model.
30
 
31
  Notebook: https://colab.research.google.com/drive/19C0zbkSCt5ncVCa4kY-ik9hSEiJcjI-F
32
+
33
+ ## Citations
34
+
35
+ AraGPT2 model:
36
+
37
+ ```
38
+ @misc{antoun2020aragpt2,
39
+ title={AraGPT2: Pre-Trained Transformer for Arabic Language Generation},
40
+ author={Wissam Antoun and Fady Baly and Hazem Hajj},
41
+ year={2020},
42
+ eprint={2012.15520},
43
+ archivePrefix={arXiv},
44
+ primaryClass={cs.CL}
45
+ }
46
+ ```
47
+
48
+ Dialect data sources:
49
+ - https://qspace.qu.edu.qa/handle/10576/15265
50
+ - https://github.com/UBC-NLP/aoc_id
51
+ - https://github.com/ryancotterell/arabic_dialect_annotation