GPT2-Einstein / tokenizer_config.json
paulo-ribeiro's picture
Adding the GPT2 tokenizer
0e0adc5 verified
{"model_max_length": 1024}