ikawrakow

/

various-2bit-sota-gguf

like 79

Can we get new SOTA 2 quants (2.31-2.40 bpw) of dolphin-2.6-mistral-7b-dpo-laser? I want see how laser and other noise reduction handles the aggressive quantizations. Thanks in advance. You rock! 🙏
https://huggingface.co/cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser