chef-gpt / added_tokens.json
auhide's picture
Upload tokenizer
f64dbcb
{
"[EOL]": 30004,
"[ING]": 30002,
"[PAD]": 30001,
"[REC]": 30003,
"[SEP]": 30000,
"[TTL]": 30005
}