Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
syssec-utd
/
statement-custom-tokenizer-1
like
0
Model card
Files
Files and versions
Community
main
statement-custom-tokenizer-1
2 contributors
History:
12 commits
jteng
Extracted special tokens map
f147d4a
verified
3 months ago
.gitattributes
1.52 kB
initial commit
3 months ago
merges.txt
86.8 kB
Extracted merges from tokenizer
3 months ago
special_tokens_map.json
29.7 kB
Extracted special tokens map
3 months ago
tokenizer.json
684 kB
Extracted tokenizer
3 months ago
tokenizer_config.json
178 kB
Trained tokenizer using syssec-utd/statement-py39-scratch-bert-2048-10
3 months ago
vocab.json
191 kB
Extracted vocabulary from tokenizer
3 months ago