tokenizer_config.json · sagorsarker/codeswitch-hineng-pos-lince at main

codeswitch-hineng-pos-lince / tokenizer_config.json

system's picture

system HF staff

Update tokenizer_config.json

c0cae31 over 3 years ago

raw history blame contribute delete

No virus

49 Bytes

{"do_lower_case": false, "model_max_length": 512}