kogpt / added_tokens.json
psyche's picture
Upload tokenizer
0ebd4a4
{
"<|endoftext|>": 32000
}