praxeswolf0d
/

WizardLM-2-8x22B-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

WizardLM-2-8x22B-GGUF Quants

Readme to be updated as addtional quants are uploaded.

Q4_K - ~80GB

Downloads last month: 78

GGUF

Model size

141B params

Architecture

llama

4-bit

Inference API

Unable to determine this model's library. Check the docs .