GPT2-Einstein / tokenizer_config.json
paulo-ribeiro's picture
Adding the GPT2 tokenizer
0e0adc5 verified
raw
history blame
No virus
26 Bytes
{"model_max_length": 1024}