GPT2-SCP-Descriptions / added_tokens.json
Azaghast's picture
add tokenizer
7625054
{"[BOS]": 50257, "[EOS]": 50258, "[PAD]": 50259}