rasyosef
/

gpt2-small-amharic-8k-128-v3

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

rasyosef commited on Jul 4

Commit

3839e96

•

1 Parent(s): 0a09afb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ pipeline_tag: text-generation
 This is a smaller version of the [gpt2](https://huggingface.co/openai-community/gpt2) decoder transformer model pretrained from scratch for **1.5 days** on **290 million tokens** of **Amharic** text.
-- It has **33.7 Million parameters**
 - The **context size** of this model is **128** tokens.
 - It has the same **tokenizer** as gpt2, trained from scratch using the same dataset with a vocabulary size of **8192**.
 - This is a base model and hasn't undergone any supervised finetuing yet.

 This is a smaller version of the [gpt2](https://huggingface.co/openai-community/gpt2) decoder transformer model pretrained from scratch for **1.5 days** on **290 million tokens** of **Amharic** text.
+- It has **29.5 Million parameters**
 - The **context size** of this model is **128** tokens.
 - It has the same **tokenizer** as gpt2, trained from scratch using the same dataset with a vocabulary size of **8192**.
 - This is a base model and hasn't undergone any supervised finetuing yet.