plotly_gpt_neo_1_3B / added_tokens.json
lagodw's picture
full sample tokenizer
4b3ae52
{"<UNK>": 50257, "<SEP>": 50258, "<PAD>": 50259}