tokenizer-arena / stats /compress_rate /deepseek_llm_7b_base.zh-Hans.json
eson's picture
update compress rate
988921c
raw
history blame
No virus
81 Bytes
{"vocab_size": 100000, "n_bytes": 2633047, "n_tokens": 605081, "n_chars": 927311}