openai-gpt / tokenizer_config.json

Commit History

Adds the tokenizer configuration file (#6)
1e0d4f3
verified

lysandre HF staff commited on