---
language:
  - ar
tags:
  - text-generation
license: apache-2.0
widget:
  - text:  "يا ليل الحب "
---

Thepoet is an Arabic poem generator, pre-trained language model based on OpenAi GPT2 architechture.

Special thanks to aubmindlab for their pretrained Arabic model - Aragpt2 - large (https://huggingface.co/aubmindlab/aragpt2-large)

AraGPT2-large adafactor 1024 1280 20 36 2.98GB/792M

Trained on two huge (APCD) datasets:

512MB Arabic Poem Comprehensive Dataset from Kaggle (https://www.kaggle.com/datasets/mohamedkhaledelsafty/best-arabic-poem-comprehensive-dataset)

150MB Arabic Poem Dataset from Kaggle(https://www.kaggle.com/datasets/ahmedabelal/arabic-poetry)

## Eval results 
Final perplexity reached was 119.5661

### BibTeX entry and citation info

```bibtex
@inproceedings{Mohamad El Abaji,
  year={2022}
}
```