Could you make a Q3KM version?
#1
by
TouchNight
- opened
I want to run it on my laptop
He might or might not, but if you are willing to use somebody else's version, I offer both status and imatrix Q3_K_M (as well as other quants such as IQ3_M): https://huggingface.co/mradermacher/CausalLM-RP-34B-i1-GGUF