gpt2-001 / tokenizer_config.json

Commit History

Added tokenizer of GPT2 with adding pad_token
7a4d764
verified

fumiyau commited on