chef-gpt-base / added_tokens.json
auhide's picture
Upload tokenizer
e1c43e3
raw
history blame
93 Bytes
{
"[EOL]": 30004,
"[ING]": 30002,
"[PAD]": 30001,
"[REC]": 30003,
"[SEP]": 30000
}