Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
xu-song
/
tokenizer-arena
like
56
Running
App
Files
Files
Community
1
7d2062e
tokenizer-arena
/
vocab
/
chatglm_6b
/
chatglm_6b
2 contributors
History:
2 commits
xu-song
fix chatglm; new feature about add_special_tokens;
d27a756
9 months ago
config.json
Safe
697 Bytes
add more tokenizers
11 months ago
ice_text.model
Safe
2.7 MB
LFS
add more tokenizers
11 months ago
tokenization_chatglm.py
Safe
12.5 kB
fix chatglm; new feature about add_special_tokens;
9 months ago
tokenizer_config.json
Safe
416 Bytes
add more tokenizers
11 months ago