GPTQ available
#7
by
MaziyarPanahi
- opened
Hi,
Thanks for sharing your amazing model with the community. Specially in such small size!
I have quantized it to GPTQ format in case anyone has low GPU resources.
https://huggingface.co/MaziyarPanahi/Starling-LM-7B-beta-GPTQ