direct_3B / tokenizer_config.json

Commit History

add tokenizer
0002941

Seonghyeon Ye commited on

tokenizer config
1d891b8

seonghyeon commited on