sciphi-micro / added_tokens.json
jtatman's picture
Upload tokenizer
d3edbb2 verified
raw
history blame
77 Bytes
{
"<|endoftext|>": 32002,
"<|im_end|>": 32001,
"<|im_start|>": 32000
}