ChatGPT-2.V2 / added_tokens.json
suriya7's picture
Upload tokenizer
52883d6 verified
raw
history blame
69 Bytes
{
"<|im_end|>": 50259,
"<|im_start|>": 50258,
"[PAD]": 50257
}