pszemraj
/

mega-ar-small-4096-wikitext-103-raw-v1

Text Generation

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Community

pszemraj commited on Sep 3, 2023

Commit

2edb5b1

•

1 Parent(s): dd315bd

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -24,7 +24,8 @@ inference:
 ## mega-ar on wikitext-103-raw-v1 (document level)
-This model is a fine-tuned version of [pszemraj/random-mega-ar-small-4096](https://huggingface.co/pszemraj/random-mega-ar-small-4096) on the `EleutherAI/wikitext_document_level` dataset (`wikitext-103-raw-v1`)
 It achieves the following results on the evaluation set:
 - Loss: 4.0338
 - Accuracy: 0.3243

 ## mega-ar on wikitext-103-raw-v1 (document level)
+This model is a fine-tuned version of [pszemraj/random-mega-ar-small-4096](https://huggingface.co/pszemraj/random-mega-ar-small-4096) on the `EleutherAI/wikitext_document_level` dataset (`wikitext-103-raw-v1`). This model has ~ 65M params.
 It achieves the following results on the evaluation set:
 - Loss: 4.0338
 - Accuracy: 0.3243