plan for quantization?

#1
by DRRRRDFFD - opened

I absolutely loved Thespis-CurtainCall's 7b version! 😭😭Do you have any plans to upload the gguf or exl2 quant?

I'm not him, but it's currently in my queue (static ones). I can also make imatrix quants if somebody wants them. The static quants will appear here: https://huggingface.co/mradermacher/Thespis-CurtainCall-8x7b-v0.3-GGUF

@mradermacher !!! Oh You seem like a miqu-ant 1000b...😭😭 I tried q5_k_m and it worked well! Thanks to both of you.

Cheers, happy to help :)

Sign up or log in to comment