tokenizer_config.json · sagorsarker/codeswitch-spaeng-pos-lince at main

codeswitch-spaeng-pos-lince / tokenizer_config.json

system's picture

system HF staff

Update tokenizer_config.json

8bc5c5c over 3 years ago

raw history blame contribute delete

No virus

49 Bytes

{"do_lower_case": false, "model_max_length": 512}