tinylama / added_tokens.json
firstgradeai's picture
Upload tokenizer
c97d71c verified
{
"<|im_end|>": 32002,
"<|im_start|>": 32001,
"[PAD]": 32000
}