llama.cpp doesn't support the q4_3 weights anymore
#6
by
AiCreatornator
- opened
https://github.com/ggerganov/llama.cpp/pull/1218
Just to warn people who are trying to get those q4_3 weights working with the newest llama.cpp versions. They don't work.
Thanks. I removed q4_3 from my other repos but forgot this one. I've removed it now.
I'll do some q5's as well and upload those in a minute.
q5_0 and q5_1 now available