xmen-de-ce-medmentions / added_tokens.json
phlobo's picture
add tokenizer
912c1f2
{"[TYPE]": 52013, "[NIL]": 52012, "[START]": 52009, "[TITLE]": 52011, "[END]": 52010}