GPT2-SCP-ContainmentProcedures / added_tokens.json
Azaghast's picture
add tokenizer
fe62aee
raw history blame
No virus
48 Bytes
{"[BOS]": 50257, "[EOS]": 50258, "[PAD]": 50259}