openai-gpt / tokenizer_config.json
lysandre's picture
lysandre HF staff
Adds tokenizer_config.json file
d06153c verified
raw
history blame
25 Bytes
{"model_max_length": 512}