Hugging Face's logo

Spaces:
yhavinga
/
dutch-tokenizer-arena
Running

App Files Community
dutch-tokenizer-arena / app.py

Commit History

Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX.
c78da21
Running

yhavinga commited on

update
f331792

eson commited on

add compression leaderboard
1b7fc74

eson commited on

update compress rate
367a536

eson commited on

update compress rate
988921c

eson commited on

add grok mixtral
480ae5d

eson commited on

add compress rate
814ee6b

eson commited on

update
1f833af

eson commited on

fix chatglm; new feature about add_special_tokens;
d27a756

eson commited on

add more tokenizers
f4973d4

eson commited on

update
7a8d6d6

eson commited on

update
9495a4f

eson commited on

update
0ce6477

eson commited on

update
6551d2c

eson commited on

update
d2551ad

eson commited on

update
8e0e4e9

eson commited on

update
6f9d07b

eson commited on

update
0177868

eson commited on

update
79b95c3

eson commited on

update
7156337

eson commited on

update
309a593

eson commited on

startup
b15345c

eson commited on

update
e4187ae

eson commited on

update
a173fe5

eson commited on

update
d10ecd7

eson commited on

update
1ee0570

eson commited on

update
428b731

eson commited on

update
751936e

eson commited on