RuntimeError: qweight and qzeros have incompatible shapes.
#6
by
bpandey23
- opened
@TheBloke getting RuntimeError: qweight and qzeros have incompatible shapes while using this revision "gptq-8bit-32g-actorder_True" is it related to instance memory or is it something else ?