FLMR / query_tokenizer /added_tokens.json
LinWeizheDragon's picture
Upload folder using huggingface_hub
3704bcf verified
{
"<BOC>": 30527,
"<BOK>": 30529,
"<BOQ>": 30525,
"<BOV>": 30522,
"<EOC>": 30528,
"<EOK>": 30530,
"<EOQ>": 30526,
"<EOV>": 30524,
"<SOV>": 30523
}