Can you produce a quantized 2.4bpw model of this model?

by xldistance - opened 20 days ago

Discussion

xldistance

20 days ago

•

edited 15 days ago

@async0x42 24GB of video memory can only run 2.4bpw quantization

xldistance changed discussion title from Can you produce a quantized 2.25bpw model of this model? to Can you produce a quantized 2.4bpw model of this model? 15 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment