x-r-hy / added_tokens.json
yerevann's picture
add tokenizer
cfc81e8
{"<s>": 50, "</s>": 51}