test1 / added_tokens.json
keloniton's picture
Upload tokenizer
c65a518 verified
raw
history blame contribute delete
73 Bytes
{
"[EOS]": 42003,
"[N]": 42000,
"[PAD]": 42001,
"[SEP]": 42002
}