This repository doesn't contain a model, but only a tokenizer that can be used with the
This tokenizer is just a copy of
from tokenizers import Tokenizer tokenizer = Tokenizer.from_pretrained("anthony/tokenizers-test")
- Downloads last month
Unable to determine this model’s pipeline type. Check the docs .