Extra `<s>` in EOG and EOS.
#1
by
notafraud
- opened
Hi! I'm seeing extra <s> in EOG and EOS tokens, i.e. <s><s> and <s></s>. It everything good with quantization? Using Ava-1.0-12B-Q6_K_L.
Ooo it looks like this one may have been made when llama.cpp tokenizer was broken, I'll remake it, sorry about that!
Thank you! Tokens are ok now, but Mistral V3 and V2 don't seem to work with this model. Asked about it here.
Tested 6_K_L, should work fine.