Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
bayartsogt
/
real-time-tokenizer
like
4
Running
App
Files
Files
Community
3fff62f
real-time-tokenizer
1 contributor
History:
6 commits
bayartsogt
adding llama2 tokenizer
3fff62f
10 months ago
.gitattributes
1.52 kB
initial commit
10 months ago
.gitignore
35 Bytes
adding llama2 tokenizer
10 months ago
README.md
260 Bytes
user test
10 months ago
app.py
2.2 kB
adding llama2 tokenizer
10 months ago
requirements.txt
36 Bytes
adding sentencepeice to req file
10 months ago