dv-wiki-gpt2 / added_tokens.json
alakxender's picture
Upload tokenizer
4b7e1e2 verified
raw
history blame
47 Bytes
{
"<|endoftext|>": 27849,
"[UNK]": 27850
}