chpradeep's picture
Upload tokenizer
338bbc7 verified
{
"</s>": 102,
"<s>": 101,
"[PAD]": 100
}