parsig_pos / added_tokens.json
shirzady1934's picture
Upload tokenizer
8aa42ae
raw
history blame
86 Bytes
{
"</s>": 6882,
"<mask>": 6885,
"<pad>": 6884,
"<s>": 6881,
"<unk>": 6883
}