Quantization

#1
by Aryanne - opened

Thanks for the quantization, can you quantize this model, idk if it's RWKV: https://huggingface.co/InsightAI/Enigma-3B

thanks for your time.

I haven't noticed this until now. I apologize for being so late.

Also, I took a quick look at your page. I find it nice that you quantize smaller models too!

no problem, the model I asked was deleted apparently by the owners

Aryanne changed discussion status to closed

Sign up or log in to comment