Update README.md
Browse files
README.md
CHANGED
@@ -8,7 +8,7 @@ widget:
|
|
8 |
example_title: Example 3
|
9 |
---
|
10 |
|
11 |
-
# gpt2-small-amharic-128-
|
12 |
|
13 |
This is a smaller version of the [gpt2](https://huggingface.co/openai-community/gpt2) decoder transformer model pretrained from scratch for **2 days** on **290 million tokens** of **Amharic** text. The **context size** of this model is **128** tokens. It has the same tokenizer as gpt2, trained from scratch using the same dataset with a vocabulary size of **8192**.
|
14 |
|
|
|
8 |
example_title: Example 3
|
9 |
---
|
10 |
|
11 |
+
# gpt2-small-amharic-128-v3
|
12 |
|
13 |
This is a smaller version of the [gpt2](https://huggingface.co/openai-community/gpt2) decoder transformer model pretrained from scratch for **2 days** on **290 million tokens** of **Amharic** text. The **context size** of this model is **128** tokens. It has the same tokenizer as gpt2, trained from scratch using the same dataset with a vocabulary size of **8192**.
|
14 |
|