Hugging Face's logo

benjicolby
/
WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1
New discussion

RTX 4090 Windows system with 96GB of RAM - I cannot get this model to load in OobaBooga - ERROR

2
#1 opened over 1 year ago by cleverest