fi-mbertmodel-monotok-adapter / tokenizer_config.json
plip's picture
Add fi-mbertmodel-monotok-adapter
c99d1f8
{"do_lower_case": false, "model_max_length": 512}