mlabonne
/

NeuralMonarch-7B

Can anybody make a q8 GGUF of this model please?

by Xhatz - opened Feb 14

Xhatz

Feb 14

I would really like it! I am not getting good results with 4_K_M and wanted to test 8-bit quant please!

Owner Feb 15

It's done :)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment