Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

moyix
/

CodexTokenizer

Model card Files Files and versions Community

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

moyix's picture

Upload tokenizer

667665e over 2 years ago

.gitattributes

1.34 kB

initial commit over 2 years ago
merges.txt

466 kB

Upload tokenizer over 2 years ago
special_tokens_map.json

438 Bytes

Upload tokenizer over 2 years ago
tokenizer.json

2.12 MB

Upload tokenizer over 2 years ago
tokenizer_config.json

659 Bytes

Upload tokenizer over 2 years ago
vocab.json

799 kB

Upload tokenizer over 2 years ago