Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
eson
/
tokenizer-arena
like
51
Running
App
Files
Files
Community
1
f331792
tokenizer-arena
/
vocab
/
baichuan
/
Baichuan-7B
1 contributor
History:
2 commits
eson
add more tokenizers
f4973d4
7 months ago
config.json
656 Bytes
update
10 months ago
configuration_baichuan.py
2.35 kB
update
10 months ago
special_tokens_map.json
411 Bytes
update
10 months ago
tokenization_baichuan.py
9.57 kB
add more tokenizers
7 months ago
tokenizer.model
1.14 MB
LFS
update
10 months ago
tokenizer_config.json
802 Bytes
update
10 months ago