Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

ocisd4
/

mistral_tokenizer_ext

Model card Files Files and versions Community

mistral_tokenizer_ext

4 contributors

History: 13 commits

JohnCheng's picture

Update README.md

d961b9c verified 11 months ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

756 Bytes

Update README.md 11 months ago
added_tokens.json

55 Bytes

Remove dummy tokens, add func_start, func_end about 1 year ago
special_tokens_map.json

414 Bytes

Upload tokenizer about 1 year ago
tokenizer.json

1.87 MB

Remove dummy tokens, add func_start, func_end about 1 year ago
tokenizer.model

538 kB
LFS

Upload tokenizer about 1 year ago
tokenizer_config.json

2.12 kB

Update tokenizer_config.json about 1 year ago