gopikachu's picture
Upload tokenizer
1771e38 verified
{
"</s>": 14,
"<s>": 13,
"[PAD]": 16,
"[UNK]": 15
}