Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

hf-internal-testing
/

llama-tokenizer

Model card Files Files and versions Community

llama-tokenizer

4 contributors

History: 10 commits

ArthurZ's picture

ArthurZ HF staff

Upload tokenizer

f1d23a0 over 1 year ago

.gitattributes

1.48 kB

initial commit almost 2 years ago
special_tokens_map.json

411 Bytes

Upload tokenizer almost 2 years ago
tokenizer.json

1.84 MB

Upload tokenizer.json over 1 year ago
tokenizer.model

500 kB
LFS

Upload tokenizer almost 2 years ago
tokenizer_config.json

700 Bytes

Upload tokenizer over 1 year ago