Blockly?
#1
by
Bit101
- opened
I'm using the latest version of kcpp but all this model replies with is Blockly over and over.
have that bug, to fix try to disable gpu offload
it fixed in future llama versions
read here about
https://huggingface.co/Qwen/Qwen2-7B-Instruct-GGUF/discussions/1
If that's the case it should be fixed in the future KCPP versions.
Or use this fork:
https://github.com/Nexesenex/kobold.cpp
This should have the latest commits merged already.