Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
stabilityai
/
arcade100k
like
3
Follow
Stability AI
16.2k
arxiv:
2402.17834
Model card
Files
Files and versions
Community
d8301d9
arcade100k
2 contributors
History:
13 commits
jon-tow
Merge branch 'main' of hf.co:jon-tow/stablelm-tokenizer-v1 into main
d8301d9
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
README.md
Safe
258 Bytes
Update README.md
over 1 year ago
arcade100k.tiktoken
Safe
1.68 MB
init: first commit
over 1 year ago
tokenization_arcade100k.py
Safe
9.92 kB
fix: re-ordering special tokens
over 1 year ago
tokenizer_config.json
Safe
160 Bytes
Create tokenizer_config.json
over 1 year ago