Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
yenniejun
/
tokenizers-languages
like
28
Running
App
Files
Files
Community
1
62551b2
tokenizers-languages
3 contributors
History:
14 commits
yenniejun
Adding example texts to show
62551b2
about 1 year ago
.gitattributes
1.48 kB
initial commit
about 1 year ago
MassiveDatasetValidationData.csv
25 MB
Updating data file with tokenizer token numbers
about 1 year ago
README.md
255 Bytes
initial commit
about 1 year ago
app.py
4.67 kB
Adding example texts to show
about 1 year ago
requirements.txt
1.09 kB
Adding requirements
about 1 year ago