krishivoice / added_tokens.json
krishi0311's picture
Upload tokenizer
7e2e3bf verified
raw
history blame
30 Bytes
{
"</s>": 30,
"<s>": 29
}