tokenizer_config.json · FacebookAI/roberta-base at main

roberta-base / tokenizer_config.json

lysandre's picture

lysandre HF staff

Adds the tokenizer configuration file (#12)

e2da8e2 verified 2 months ago

raw history blame contribute delete

No virus

25 Bytes

{"model_max_length": 512}