Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
eson
/
tokenizer-arena
like
50
Running
App
Files
Files
Community
main
tokenizer-arena
/
utils
/
text_util.py
Commit History
remove vocabs; update compression_app; add character_app;
2bd606a
eson
commited on
May 21
add compression leaderboard
1b7fc74
eson
commited on
May 1
add compress rate
814ee6b
eson
commited on
Apr 22
add more tokenizers
f4973d4
eson
commited on
Dec 1, 2023
update
751936e
eson
commited on
Aug 30, 2023