mt_coref_en_fr_gender / added_tokens.json

Asaf Yehoodai

add tokenizer

0a28e2f over 1 year ago

No virus

794 Bytes

{"<ENT0>": 59514, "</ENT0>": 59515, "<ENT1>": 59516, "</ENT1>": 59517, "<ENT2>": 59518, "</ENT2>": 59519, "<ENT3>": 59520, "</ENT3>": 59521, "<ENT4>": 59522, "</ENT4>": 59523, "<ENT5>": 59524, "</ENT5>": 59525, "<ENT6>": 59526, "</ENT6>": 59527, "<ENT7>": 59528, "</ENT7>": 59529, "<ENT8>": 59530, "</ENT8>": 59531, "<ENT9>": 59532, "</ENT9>": 59533, "<ENT10>": 59534, "</ENT10>": 59535, "<ENT11>": 59536, "</ENT11>": 59537, "<ENT12>": 59538, "</ENT12>": 59539, "<ENT13>": 59540, "</ENT13>": 59541, "<ENT14>": 59542, "</ENT14>": 59543, "<ENT15>": 59544, "</ENT15>": 59545, "<ENT16>": 59546, "</ENT16>": 59547, "<ENT17>": 59548, "</ENT17>": 59549, "<ENT18>": 59550, "</ENT18>": 59551, "<ENT19>": 59552, "</ENT19>": 59553, "<MALE>": 59554, "</MALE>": 59555, "<FEMALE>": 59556, "</FEMALE>": 59557}