GPT2-SCP-ContainmentProcedures / added_tokens.json
Azaghast's picture
add tokenizer
fe62aee
{"[BOS]": 50257, "[EOS]": 50258, "[PAD]": 50259}