gpt2_oscar-mini / added_tokens.json
Tamnemtf's picture
Upload tokenizer
cadd565 verified
{
"<|endoftext|>": 50257
}