kogpt2-chat / added_tokens.json
yoonhero's picture
add tokenizer
d718a1d
{
"<|endoftext|>": 51200
}