rasyosef
/

gpt2-oscar-amharic-tokenizer

Inference Endpoints

Model card Files Files and versions Community

rasyosef commited on Jan 31

Commit

5b389e4

•

1 Parent(s): 6bbb3d0

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -15,4 +15,5 @@ You can load the tokenizer from huggingface hub as follows.
 from transformers import AutoTokenizer
 tokenizer = AutoTokenizer.from_pretrained("rasyosef/gpt2-oscar-amharic-tokenizer")
 ```

 from transformers import AutoTokenizer
 tokenizer = AutoTokenizer.from_pretrained("rasyosef/gpt2-oscar-amharic-tokenizer")
+tokenizer("አባይን ያላየ የፕሌን ቲኬት እችለዋለው።")
 ```