Any chance of a 3.75bpw?

by gghfez - opened Apr 18

gghfez

Apr 18

Thanks for the exl2 quants. Any chance of a 3.75BPW for those of us with 72GB of VRAM?

Apr 18

Seconded. I assumed it was coming and not yet uploaded.

Owner Apr 18

Sure thing. It's uploading now. Check here in a few minutes.

gghfez

Apr 18

Thanks mate!

gghfez

Apr 19

Seconded. I assumed it was coming and not yet uploaded.

I reckon just 3.75 wasn't in his shell script, because prior to these 8x22b models, there was no real demand for it with the 70b, 103b, etc models.

Apr 19

I swear I saw it for maxtral base.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment