GGUF quants available

by mradermacher - opened Mar 6

Mar 6

Judging from the daybreak-mixtral model card, this must be quite the perverted model with lots of secret sauce :)

In any case, I made static and imatrix quants of this model, in hope of this being useful:

Cheers!

Owner Mar 6

•

Thanks!

Edit: Wow, that's very nice. I added links to those in the model card(s).

Mar 6

Cool! If you think it helps, I am open to quantize other models, btw.

mradermacher changed discussion status to closed Mar 6

May 5

Could someone upload to ollama?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment