mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

gguf format

#2

by GyroO - opened Mar 2

GyroO

Mar 2

is it possible to do a gguf version?

Mobius Labs GmbH org Mar 3

Hi! This is not compatible with GGML, you can only use this HF's transformers model.

mobicham changed discussion status to closed Mar 3

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment