Anyway to make gguf's? :)

#1
by vdruts - opened

IQ2/IQ3

I was just about to ask for the same thing. imatrix GGUFs (at least up to Q6_K) would be super appreciated!
I usually download the ones from @mradermacher :)

I've put it in my queue, should be done by tomorrow, if nothing goes wrong :)

I've put it in my queue, should be done by tomorrow, if nothing goes wrong :)

Thanks for that, making GGUF's and quants is something i'm still figuring out.

Any updates?

What kind of update would you like to have?

I've put it in my queue, should be done by tomorrow, if nothing goes wrong :)

THANK YOU!

What kind of update would you like to have?

One on this? "I've put it in my queue, should be done by tomorrow, if nothing goes wrong :)"

Not sure what you mean, did you run into any problems?

Sign up or log in to comment