codellama-13b-oasst-sft-v10 / added_tokens.json
andreaskoepf's picture
Upload tokenizer
efd290b
raw
history blame
142 Bytes
{
"<CLS>": 32016,
"<EOD>": 32018,
"<MASK>": 32019,
"<PAD>": 32020,
"<SEP>": 32017,
"<|im_end|>": 32022,
"<|im_start|>": 32021
}