tetra-tag-en / tokenizer_config.json
system's picture
system HF staff
Update tokenizer_config.json
dd3f080
{"do_lower_case": true, "model_max_length": 512}