punctuatorid / tokenizer_config.json

Commit History

add tokenizer config
137b7a1

candra commited on