Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

tnieva
/

test-tokenizer

Model card Files Files and versions Community

1 contributor

History: 4 commits

tnieva's picture

Upload tokenizer

5d91cb3 over 2 years ago

.gitattributes

1.38 kB

initial commit over 2 years ago
merges.txt

1.05 kB

add tokenizer over 2 years ago
special_tokens_map.json

99 Bytes

add tokenizer over 2 years ago
tokenizer.json

10.7 kB

add tokenizer over 2 years ago
tokenizer_config.json

255 Bytes

add tokenizer over 2 years ago
vocab.json

3.95 kB

add tokenizer over 2 years ago