tokenizer_config.json · sagorsarker/codeswitch-hineng-lid-lince at main

codeswitch-hineng-lid-lince / tokenizer_config.json

system's picture

system HF staff

Update tokenizer_config.json

7ac0f2e over 3 years ago

raw history blame contribute delete

No virus

49 Bytes

{"do_lower_case": false, "model_max_length": 512}