umt5 / added_tokens.json
ArthurZ's picture
ArthurZ HF staff
Upload tokenizer
4507c51
raw
history blame
189 Bytes
{
"[book]": 11,
"[c4]": 12,
"[code]": 10,
"[convo]": 7,
"[eod]": 4,
"[eot]": 15,
"[fc]": 8,
"[ffc]": 9,
"[forum]": 14,
"[news]": 13,
"[translate]": 6,
"[wiki]": 5
}