Q4_k_s please
#1
by
Hoioi
- opened
Could you please release the Q4_k_s variant of this model?
You can get Q4 from https://huggingface.co/senseable/Smaug-72B-v0.1-gguf
Yes, but my system can run Q4_k_s, but that wasn't available there too.
Ah, I see. Unfortunately I no longer have the original files so I would have to download and convert again... if I get a chance later maybe.
That's fine. Thank you so much.
Hoioi
changed discussion status to
closed