quant

#4
by panniW - opened

@TheBloke
Can this model be quantized? is there a quant model like gptq format

Yeah looks like it's a Llama model. I'll add it to the queue.

Sign up or log in to comment