personaGPT / added_tokens.json
af1tang's picture
tokenizer update
7332f20
raw history blame
No virus
108 Bytes
{"<|sep|>": 50257, "<|act|>": 50262, "<|cls|>": 50258, "<|start|>": 50259, "<|p1|>": 50260, "<|p2|>": 50261}