YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Made by merging the following lora: https://huggingface.co/Neko-Institute-of-Science/VicUnLocked-30b-LoRA

Then quantizing with ooba's old CUDA branch of GPTQ

python llama.py vicunlocked-30b c4 --wbits 4 --true-sequential --act-order --save_safetensors vicunlocked-30b-4bit.safetensors

Downloads last month: 8

Inference API

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.