Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ model-index:
|
|
| 8 |
|
| 9 |
# gpt-4-est-base
|
| 10 |
|
| 11 |
-
|
| 12 |
|
| 13 |
[Colab demo](https://colab.research.google.com/drive/1Bp7mGEQ1vmyqXPyXHV1yj68cRZEi2mq4?usp=sharing)
|
| 14 |
|
|
|
|
| 8 |
|
| 9 |
# gpt-4-est-base
|
| 10 |
|
| 11 |
+
This is GPT for Estonian. Not GPT-4 :-) This is the base-size [GPT2](https://huggingface.co/docs/transformers/model_doc/gpt2) model, trained from scratch on 2.2 billion words (Estonian National Corpus + News Crawl + Common Crawl) for 3 epochs.
|
| 12 |
|
| 13 |
[Colab demo](https://colab.research.google.com/drive/1Bp7mGEQ1vmyqXPyXHV1yj68cRZEi2mq4?usp=sharing)
|
| 14 |
|