How to run the Int4 quantized model？

#10

by CharlesLincoln - opened 26 days ago

26 days ago

Same as the title

CharlesLincoln changed discussion title from How to run the 4-bit quantized model？ to How to run the INT4 quantized model？ 26 days ago

CharlesLincoln changed discussion title from How to run the INT4 quantized model？ to How to run the Int4 quantized model？ 26 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment