rugpt-neo-1.3b / special_tokens_map.json
AlexWortega's picture
Upload tokenizer
1f2433e
raw
history blame
No virus
207 Bytes
{
"additional_special_tokens": [
"q:",
"summarize",
"a",
"style"
],
"bos_token": "<endoftext>",
"eos_token": "<endoftext>",
"pad_token": "<|pad|>",
"unk_token": "<|endoftext|>"
}