Navarna_v0_1_OpenHermes_Hindi / added_tokens.json
TokenBender's picture
Upload tokenizer
9610af4 verified
{
"<|im_end|>": 32000,
"<|im_start|>": 32001
}