Update README.md
Browse files
README.md
CHANGED
|
@@ -19,6 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 19 |
# TinySatirik-sm
|
| 20 |
|
| 21 |
This model is a pre-trained version of really tiny LLama2 model on an [anekdots](https://huggingface.co/datasets/igorktech/anekdots) dataset.
|
|
|
|
|
|
|
|
|
|
| 22 |
It achieves the following results on the evaluation set:
|
| 23 |
- Loss: 1.2643
|
| 24 |
|
|
|
|
| 19 |
# TinySatirik-sm
|
| 20 |
|
| 21 |
This model is a pre-trained version of really tiny LLama2 model on an [anekdots](https://huggingface.co/datasets/igorktech/anekdots) dataset.
|
| 22 |
+
|
| 23 |
+
Inspired by [TinyStories](https://arxiv.org/abs/2305.07759).
|
| 24 |
+
|
| 25 |
It achieves the following results on the evaluation set:
|
| 26 |
- Loss: 1.2643
|
| 27 |
|