julien-c HF staff commited on
Commit
14b4eaa
1 Parent(s): 3895da9

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/akhooli/gpt2-small-arabic-poetry/README.md

Files changed (1) hide show
  1. README.md +45 -0
README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: "ar"
3
+ tags:
4
+ - text-generation
5
+ license: ""
6
+ datasets:
7
+ - Arabic poetry from several eras
8
+ ---
9
+
10
+ # GPT2-Small-Arabic-Poetry
11
+
12
+ ## Model description
13
+
14
+ Fine-tuned model of Arabic poetry dataset based on gpt2-small-arabic.
15
+
16
+ ## Intended uses & limitations
17
+
18
+ #### How to use
19
+
20
+ An example is provided in this [colab notebook](https://colab.research.google.com/drive/1mRl7c-5v-Klx27EEAEOAbrfkustL4g7a?usp=sharing).
21
+
22
+ #### Limitations and bias
23
+
24
+ Both the GPT2-small-arabic (trained on Arabic Wikipedia) and this model have several limitations in terms of coverage and training performance.
25
+ Use them as demonstrations or proof of concepts but not as production code.
26
+
27
+ ## Training data
28
+
29
+ This pretrained model used the [Arabic Poetry dataset](https://www.kaggle.com/ahmedabelal/arabic-poetry) from 9 different eras with a total of around 40k poems.
30
+ The dataset was trained (fine-tuned) based on the [gpt2-small-arabic](https://huggingface.co/akhooli/gpt2-small-arabic) transformer model.
31
+
32
+ ## Training procedure
33
+
34
+ Training was done using [Simple Transformers](https://github.com/ThilinaRajapakse/simpletransformers) library on Kaggle, using free GPU.
35
+
36
+ ## Eval results
37
+ Final perplexity reached ws 76.3, loss: 4.33
38
+
39
+ ### BibTeX entry and citation info
40
+
41
+ ```bibtex
42
+ @inproceedings{Abed Khooli,
43
+ year={2020}
44
+ }
45
+ ```