13B quantization
#1
by
samgreen
- opened
Hi. A 13B version of ShareGPT4V was released earlier today. Nobody seems to have quantized it so far. Any chance you'd be able to do it?
I also would like someone to upload a 13B gguf for this model please!
Thank you for helping the cimmunity by uploading gguf's!
Hey, I uploaded it here: https://huggingface.co/nakodanei/ShareGPT4V-13B_GGUF
Could you also please quant 13B model to Q8 gguf for my 3090?