MaziyarPanahi
/

WizardLM-2-8x22B-GGUF

Text Generation

4-bit precision

8-bit precision

arxiv:2304.12244

arxiv:2306.08568

arxiv:2308.09583

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

And Poof. The Wizard Vanished.

#13

by Phil337 - opened Apr 16

Phil337

Apr 16

Thanks for the quick work quantizing this.

Phil337 changed discussion status to closed Apr 16

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment