YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Airoboros 33b GPT4 1.2 merged with kaiokendev's 33b SuperHOT 8k LoRA, quantised using GPTQ-for-LLaMa.

To easily use this model, you can use Oobabooga's Text Generation WebUI and run it with the --monkeypatch flag (and use the Exllama loader for best speeds. Note this must be manually installed unless you use the 1 click installer.)

Downloads last month
14
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.