gpt2-lotr-fellowship / added_tokens.json
mindwrapped's picture
add tokenizer
d04e442
{
"<|pad|>": 50258,
"<|startoftext|>": 50257
}