4bit
#1
by
Peeepy
- opened
Hey, would you consider uploading 4bit no groupsize for us gpulets with only 24GB VRAM?
Thanks! :)
Sure thing. I have another training job running right now. Once it finishes late tomorrow I’ll quantize again without groupsize and upload it here!
Thank you so much! I'm excited to try it.