Always speaks in latin?
#1
by
tomasmcm
- opened
What am I doing wrong? I've tried with both LM Studio and llama.cpp, but the Q5_K_M just speaks what looks like to be latin?
<|im_start|>system\nYou are a helpful assistant. Perform the task to the best of your ability.<|im_end|>\n<|im_start|>user\nHi there, how are you doing?<|im_end|>\n<|im_start|>assistant\n
reluct increa accla secon encomp inev desir emphat affor fuf guarante maneu squa fta embra unden effe perfet strick purcha disagre milf depic impra inconce ftu volunte alre ?... shenan erad accla increa reluct increa accla secon encomp inev desir emphat affor fuf guarante maneu squa fta embra unden effe perfet
Seems to be a problem with the GGUF quantisation because the original model is working well here https://huggingface.co/spaces/tomasmcm/sam-dolphin-2.8-gemma-2b
I've had this problem too, I will re Quantize this model on a later date.
Isaak-Carter
changed discussion status to
closed