Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
bayartsogt
/
real-time-tokenizer
like
4
Running
App
Files
Files
Community
0afb4f9
real-time-tokenizer
1 contributor
History:
7 commits
bayartsogt
trust_remote_code=True
0afb4f9
10 months ago
.gitattributes
1.52 kB
initial commit
10 months ago
.gitignore
35 Bytes
adding llama2 tokenizer
10 months ago
README.md
260 Bytes
user test
10 months ago
app.py
2.23 kB
trust_remote_code=True
10 months ago
requirements.txt
36 Bytes
adding sentencepeice to req file
10 months ago
test_transformers.py
477 Bytes
trust_remote_code=True
10 months ago