Can you make a 2.25bpw quantization for this model?

#4
by xldistance - opened

@LoneStriker 24GB of video memory can only run 2.4bpw quantization

Sign up or log in to comment