tsumeone's picture
4bit quant (made with occam's gptq fork)
2a9628b