LLama_dbricks_lamini / added_tokens.json
Imadken's picture
Upload tokenizer
c99e1cc verified
raw
history blame contribute delete
60 Bytes
{
"</s>": 2,
"<s>": 1,
"<unk>": 0,
"[PAD]": 32000
}