dummy / tokenizer_config.json
mengzhouxia's picture
added tokenizer
a5e9388
raw
history blame contribute delete
48 Bytes
{"do_lower_case": true, "model_max_length": 512}