q4 kml as well?

by Yhyu13 - opened May 9, 2024

Yhyu13

May 9, 2024

Hi,

Would you like to release q4 k m,l version as well? the q5 version just overflow VRAM on my 48GB bench.

Thanks!

0-hero

Quant Factory org May 9, 2024

@Yhyu13 yes, the upload failed last time. Will upload the Q4,3 & 2s within the next 2 days

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment