rugpt-neo-1.3b / added_tokens.json
AlexWortega's picture
Upload tokenizer
f2e6c18
raw
history blame
128 Bytes
{
"<endoftext>": 50257,
"<|endoftext|>": 50258,
"<|pad|>": 50259,
"q:": 50260,
"style": 50262,
"summarize": 50261
}