|
--- |
|
|
|
language: |
|
- "ur" |
|
license: "mit" |
|
datasets: |
|
- "Urdu-news-dataset" |
|
|
|
--- |
|
|
|
|
|
# GPT-2 |
|
Fine tune gpt2 model on Urdu news dataset using a causal language modeling (CLM) objective. |
|
|
|
### How to use |
|
|
|
You can use this model directly with a pipeline for text generation. Since the generation relies on some randomness, we |
|
set a seed for reproducibility: |
|
|
|
```python |
|
from transformers import AutoTokenizer, AutoModelForCausalLM |
|
|
|
tokenizer = AutoTokenizer.from_pretrained("Imran1/gpt2-urdu-news") |
|
|
|
model = AutoModelForCausalLM.from_pretrained("Imran1/gpt2-urdu-news") |
|
``` |
|
## Training data |
|
I fine tune gpt2 for downstream task like text generation, only for 1000 sample so it may not be good. Due to resources limitation. |
|
|
|
|
|
## Evaluation results |
|
training loss 3.042 |
|
|
