3bit gptq?
#1
by
llama-anon
- opened
will a 3bit gptq quant be released aswell? it would be perfect for 12gig cards
I'll look into it! If I have the spare compute in my budget I'll try to put out a 3bit version in the next day or two.