File size: 278 Bytes
e8c6cb9 43f63bf e8c6cb9 |
1 2 3 4 5 6 7 8 9 10 |
This repository doesn't contain a model, but only a tokenizer that can be used with the
`tokenizers` library.
This tokenizer is just a copy of `bert-base-uncased`.
```python
from tokenizers import Tokenizer
tokenizer = Tokenizer.from_pretrained("anthony/tokenizers-test")
```
|