Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
bayartsogt
/
real-time-tokenizer
like
4
Running
App
Files
Files
Community
main
real-time-tokenizer
1 contributor
History:
9 commits
bayartsogt
adding falcon
473996d
8 months ago
.gitattributes
1.52 kB
initial commit
9 months ago
.gitignore
35 Bytes
adding llama2 tokenizer
8 months ago
README.md
260 Bytes
user test
9 months ago
app.py
2.32 kB
adding falcon
8 months ago
requirements.txt
36 Bytes
adding sentencepeice to req file
9 months ago
test_transformers.py
477 Bytes
trust_remote_code=True
8 months ago