PlatYi-34B-200k-Q-FastChat / added_tokens.json
kyujinpy's picture
Upload tokenizer
a69855f
{
"<unk>": 0,
"<|endoftext|>": 2,
"<|startoftext|>": 1
}