llama-2-tiet-dataset / added_tokens.json
hraj18's picture
Upload tokenizer
2fff734 verified
raw
history blame contribute delete
No virus
39 Bytes
{
"<pad>": 32000,
"[PAD]": 32001
}