gpt2-conversional / added_tokens.json
maneln's picture
Upload tokenizer
48b7883 verified
raw
history blame contribute delete
107 Bytes
{
"<mask>": 50261,
"<|ASSISTANT|>": 50259,
"<|End|>": 50258,
"<|USER|>": 50260,
"[PAD]": 50257
}