ZeroShotWiki / tokenizer_config.json
hantian2's picture
Add tokenizer
4623300
{"do_lower_case": true, "model_max_length": 512}