FPHam

/

Plot_BOT_V3_13b_GPTQ

like 0

Any chance you could release a GGUF of this?

I'd love to try it, but I'm on a M1 Mac... so a little bit of nvidia-envy going on here. On the other hand, at q5 or q8 quant would be great since my system ram is shared with the gpu.

And please don't bother if this is too much trouble. I'm new, so I don't really know if I'm asking for something easy or hard.

Either way, thanks in advance!