rdk31
/

Mixtral-8x7B-Instruct-v0.1-polish

Text Generation

text-generation-inference

Model card Files Files and versions Community

Possibly a version to run on 24gb of vram?

#1

by rvsh - opened Jan 13

rvsh

Jan 13

Can you provide the quantized model to run on 24gb of vram?
Thank you in advance.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment