llamaturb / added_tokens.json
mohssineben's picture
Upload tokenizer
32e1176 verified
raw
history blame
21 Bytes
{
"<pad>": 32000
}