Could you please load a q4 version for this model?

#1
by acsaga - opened

Thanks:)

Sorry, only now saw this. I am actually training a new version of this one. Will upload q4_k_m and q5_k_m when done.

Sign up or log in to comment