zero-shot-explicit-gpt2 / added_tokens.json
StefanH's picture
add tokenizer
3e1f999
{"[eot]": 50258, "<|question|>": 50259, "[QUES]": 50263, "<|text|>": 50260, "<|answer|>": 50261, "[ANSW]": 50265, "[PAD]": 50257, "[TEXT]": 50264, "<|answer_sep|>": 50262}