Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Salesforce
/
xgen-tokenizer3
like
1
License:
apache-2.0
Model card
Files
Files and versions
Community
main
xgen-tokenizer3
1 contributor
History:
3 commits
enijkamp
Update tokenizer_config.json
cfb24a3
verified
2 months ago
.gitattributes
1.52 kB
initial commit
3 months ago
README.md
31 Bytes
initial commit
3 months ago
merges.txt
917 kB
Upload 5 files
3 months ago
special_tokens_map.json
98 Bytes
Upload 5 files
3 months ago
tokenizer.json
4.23 MB
Upload 5 files
3 months ago
tokenizer_config.json
422 Bytes
Update tokenizer_config.json
2 months ago
vocab.json
2.01 MB
Upload 5 files
3 months ago