dummy-tokenizer-wordlevel / tokenizer_config.json

Commit History

add tokenizer
383e287

SaulLu commited on