franken-SOLAR-18B-v1.0 / added_tokens.json
vicgalle's picture
Update tokeniser
1041239 verified
{
"<|im_end|>": 32000,
"<|im_start|>": 32001
}