3bit quant?
#1
by
llama-anon
- opened
a 3bit gptq quant would allow this model to work on 12gig cards
llama-anon
changed discussion title from
3bit quant
to 3bit quant?
a 3bit gptq quant would allow this model to work on 12gig cards