Doesn't seem to quantize well? Or the OG finetune is pretty bad.
#1
by
dillfrescott
- opened
I cannot decide which 😅
This is a bad upload where the uploader used an outdated quantizer. Koboldcpp gives a warning when opening it.
So you get the crippled llama3 tokenizer.