Problem Model

#1
by ClaudioItaly - opened

this model is broken. He starts making endless signs. I've tried every way, I give up
2024-07-02_225537.png

It's not broken for me, you need the last llama.cpp.

What he said ^

And if you're still having issues, make sure flash attention is off

Sign up or log in to comment