plan for quantization?
#1
by
DRRRRDFFD
- opened
I absolutely loved Thespis-CurtainCall's 7b version! 😭😭Do you have any plans to upload the gguf or exl2 quant?
I'm not him, but it's currently in my queue (static ones). I can also make imatrix quants if somebody wants them. The static quants will appear here: https://huggingface.co/mradermacher/Thespis-CurtainCall-8x7b-v0.3-GGUF
@mradermacher !!! Oh You seem like a miqu-ant 1000b...😭😭 I tried q5_k_m and it worked well! Thanks to both of you.
Cheers, happy to help :)