Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

GGML variant of WizardLM-30b-V1.0, for use on 24GB cards such as 3090.

Update pushed 6/14 that resolved garbage output on llama.cpp, not tested using other tools.

Requires a recent build of llama.cpp that supports the K-quant methods (June or later).

Quant was prepared using llama.cpp build on 6/14/2023.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .