tokenizer_config.json · flaubert/flaubert_base_cased at main

flaubert_base_cased / tokenizer_config.json

flaubert's picture

Updates incorrect tokenizer configuration file (#2)

6a14f70 verified about 2 months ago

raw history blame contribute delete

No virus

72 Bytes

{"do_lower_case": false, "do_lowercase": false, "model_max_length": 512}