Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
yenniejun
/
tokenizers-languages
like
24
Running
App
Files
Files
Community
1
e7c169f
tokenizers-languages
3 contributors
History:
25 commits
yenniejun
Updating link to blog post
e7c169f
8 months ago
.github
Create sync_hf_hub.yaml for syncing repo to HF
about 1 year ago
img
Adding images for README
about 1 year ago
.gitattributes
1.48 kB
initial commit
about 1 year ago
LICENSE.txt
20.8 kB
Adding license
about 1 year ago
MassiveDatasetValidationData.csv
25 MB
Updating data file with tokenizer token numbers
about 1 year ago
README.md
1.69 kB
Updating link to blog post
8 months ago
app.py
6.04 kB
Updating the About the Project section
8 months ago
requirements.txt
1.09 kB
Adding requirements
about 1 year ago