xmen-en-ce-medmentions / added_tokens.json
phlobo's picture
add tokenizer
2c84834
{"[NIL]": 30525, "[END]": 30523, "[TITLE]": 30524, "[START]": 30522, "[TYPE]": 30526}