Commit History

update: tokenizer_config.json
74370b4

tealgreen0503 commited on

feat: add custom normal tokenizer
ac868f8

tealgreen0503 commited on

feat: add custom fast tokenizer
dc384f8

tealgreen0503 commited on

Update README.md
8336809

nobu-g commited on

Update README.md
b95c7fc

nobu-g commited on

Update README.md
ca87111

nobu-g commited on

Update tokenizer_config.json
126d426

nobu-g commited on

fix README.md
45fc723

nobu-g commited on

tweak
06c4e0f

nobu-g commited on

first commit
11debab

nobu-g commited on

initial commit
a3d0f70

nobu-g commited on