---
license: other
---

NOTE: Safetensor 4bit quant will be uploaded within the day. Cheers.

This is a GPTQ 4 bit quant of ChanSung's Elina 33b.
This is a LlaMa based model; LoRA merged with latest transformers conversion.
Quantized with GPTQ, --wbits 4 --act-order --true-sequential --save_safetensors c4.

128 groupsize was not used so those running this on a consumer GPU with 24GB VRAM can run it at full
context (2048) without any risk of OOM.


Original LoRA:
https://huggingface.co/LLMs/Alpaca-LoRA-30B-elina


Repo:
https://huggingface.co/LLMs


Likely Author:
https://huggingface.co/chansung