TIPO-100M / added_tokens.json
KBlueLeaf's picture
Upload directory 'TIPO-100M_21kstep', on 2024-11-03 17:40:06 CST
7257612 verified
raw
history blame
372 Bytes
{
"<|empty|>": 32000,
"<|gen_meta|>": 32012,
"<|long_to_tag|>": 32006,
"<|long|>": 32003,
"<|short_to_long_to_tag|>": 32011,
"<|short_to_long|>": 32008,
"<|short_to_tag_to_long|>": 32010,
"<|short_to_tag|>": 32007,
"<|short|>": 32002,
"<|tag_to_long|>": 32005,
"<|tag_to_short_to_long|>": 32009,
"<|very_long|>": 32004,
"<|very_short|>": 32001
}