Pallas-0.5-frankenmerge / added_tokens.json
Mihaiii's picture
Upload tokenizer
65ec373
raw
history blame
36 Bytes
{
"</s>": 64001,
"<s>": 64000
}