Chat_GPT-2 / added_tokens.json
KhantKyaw's picture
Upload tokenizer
f54ea4f verified
raw
history blame
75 Bytes
{
"<BOS>": 50257,
"<EOS>": 50258,
"<PAD>": 50260,
"<SEP>": 50259
}