Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
yenniejun
/
tokenizers-languages
like
20
Running
App
Files
Files
Community
main
tokenizers-languages
3 contributors
History:
26 commits
yenniejun
Updating link to blog in app
c4e64d6
7 months ago
.github
Create sync_hf_hub.yaml for syncing repo to HF
11 months ago
img
Adding images for README
11 months ago
.gitattributes
1.48 kB
initial commit
about 1 year ago
LICENSE.txt
20.8 kB
Adding license
11 months ago
MassiveDatasetValidationData.csv
25 MB
Updating data file with tokenizer token numbers
about 1 year ago
README.md
1.69 kB
Updating link to blog post
7 months ago
app.py
6.04 kB
Updating link to blog in app
7 months ago
requirements.txt
1.09 kB
Adding requirements
about 1 year ago