TheBloke
/

MixtralRPChat-ZLoss-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Why AWQ for this Mixtral but not for the original?

#1

by MichaelMcCulloch - opened Dec 22, 2023

MichaelMcCulloch

Dec 22, 2023

I assume there's a rational reason for it. Curious what it is.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment