Fixed-Vocab-Tokenizer / special_tokens_map.json
mrshlltaylor's picture
Upload tokenizer
c013431 verified
raw
history blame contribute delete
No virus
109 Bytes
{
"cls_token": "0",
"mask_token": "a01",
"pad_token": "a0",
"sep_token": "a",
"unk_token": "a00"
}