YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
This is a GPTQ 4-bit version of WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b
Quanitized using commit df77083 of GPTA-for-LLaMa with the following settings:
wikitext2 --wbits 4 --true-sequential --act-order --save_safetensors
Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility.
license: other
- Downloads last month
- 11
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.