DialoGPT-special-tokens-medium4 / added_tokens.json
Deeokay's picture
Upload tokenizer
9b83c5a verified
raw
history blame
326 Bytes
{
"<|BEGIN_ANALYSIS|>": 50260,
"<|BEGIN_CLASSIFICATION|>": 50266,
"<|BEGIN_QUERY|>": 50259,
"<|BEGIN_RESPONSE|>": 50262,
"<|BEGIN_SENTIMENT|>": 50264,
"<|END_ANALYSIS|>": 50261,
"<|END_CLASSIFICATION|>": 50267,
"<|END_RESPONSE|>": 50263,
"<|END_SENTIMENT|>": 50265,
"<|PAD|>": 50258,
"<|STOP|>": 50257
}