metadata
datasets:
- wikitext
language:
- en
metrics:
- perplexity
Model Details
GPT-2 Pretrained on Wikitext-103 (180M sentences) on 32GB V100 GPU for around 1.10L iterations.
Val_loss vs train_loss:
Model Description
Perplexity: 22.87
Out-of-Scope Use
Just a test model. Please don't expect good results.