gpt2-p10k / added_tokens.json
augustocsc's picture
Upload tokenizer
0408467 verified
raw
history blame contribute delete
No virus
51 Bytes
{
"<|pad|>": 50258,
"<|startoftext|>": 50257
}