Any chance for Q4_2 and Q4_3 quantizations?

#1
by CeeGee - opened

Just wondering! The reason why I ask is this appears to be the GGML version of one of the most highly rated 7B models on the Open LLM Leaderboard and I understand quantizations Q4_2 and Q4_3 to be updated versions of Q4_0 and Q4_1, respectively. If not, no biggie, just thought I'd ask.

Thanks!

@CeeGee Not now but if ggml author add them again, I will do it. :)

edp1096 changed discussion status to closed

Sign up or log in to comment