mbarthez / tokenizer_config.json
moussaKam's picture
Adds missing tokenizer configuration file (#2)
71e56cb verified
{"model_max_length": 1024}