gpt2-small-bgwiki / added_tokens.json
auhide's picture
Upload tokenizer
dca61c7
raw
history blame
75 Bytes
{
"[CLS]": 50257,
"[EOL]": 50260,
"[PAD]": 50259,
"[SEP]": 50258
}