Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
yhavinga
/
dutch-tokenizer-arena
like
6
Running
App
Files
Files
Community
1
a6aee1d
dutch-tokenizer-arena
/
examples.py
Commit History
update
24b4aa5
xu-song
commited on
Feb 26
update
1f833af
xu-song
commited on
Feb 26
fix tiktoken
a6c67ec
xu-song
commited on
Feb 25
fix chatglm; new feature about add_special_tokens;
d27a756
xu-song
commited on
Jan 31
update
a37f943
xu-song
commited on
Jan 26
add more tokenizers
f4973d4
xu-song
commited on
Dec 1, 2023
update
9495a4f
xu-song
commited on
Sep 18, 2023