abduh1 / added_tokens.json
sabduh77's picture
Upload added_tokens.json
d2aded9 verified
{
"\t": 32109,
"\n": 32103,
" ": 32106,
"<": 32101,
"[PAD]": 32100,
"\\": 32107,
"^": 32108,
"`": 32105,
"{": 32102,
"}": 32104
}