mistral-community
/

Mixtral-8x22B-v0.1-4bit

Size in 4bit ?

by Nicolas-BZRD - opened Apr 10

Apr 10

Hey guys, thanks for the sharing.

Do you have the size once the model is quantised in 4 bit ?

Mistral Community org Apr 10

Around ~75GB

Apr 10

thx !

Nicolas-BZRD changed discussion status to closed Apr 10

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment