corrupt download or bad file?
#1
by
Terminus-26
- opened
Hello
I downloaded ggml-airoboros-34b-3.2-iq3_xs.gguf with LM Studio but it can't load it.
I'm not sure if the download was corrupted or the file has a problem, will you please check that?
I have another question, is iq4_xs much better than iq3_xs?
Thank you very much
I don't know which commit LM Studio is running but you need a really recent build of llama.cpp (i.e. at least commit 494c870) to run this quants.
As for IQ4_XS you will need to test, please have a look at this chart.
Tested with Koboldcpp and it works great.
Tank you