General discussion/quantization.

by Lewdiculous - opened Mar 15

Mar 15

Congrats on model performance!

Owner Mar 15

I'll be uploading GGUF quants at:
https://huggingface.co/Lewdiculous/RoleBeagle-11B-GGUF-IQ-Imatrix

Awesome, thank you!

Mar 15

No problem, it was a request from @saishf . Keep up the good experimentation and happy cooking.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment