Hugging Face's logo

BigHuggyD
/
BigHuggyD-Grey-WizardLM-2-8x22B_exl2_8.0bpw_h8

Text Generation
Transformers
Safetensors
mixtral
conversational
Inference Endpoints
text-generation-inference
8-bit precision
exl2
Model card Files Community
1
Edit model card

EXL2 8.0BPW Quant of BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B

Downloads last month
0
Inference API
Text Generation
Examples
Input a message to start chatting with BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_8.0bpw_h8.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.