grimulkan
/

lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2 / README.md

grimulkan's picture

Update README.md

69657e9 verified 6 months ago

|

No virus

167 Bytes

	---
	license: cc-by-2.0
	---

	This is an EXL2 6-bit quantization of [lzlv-longLORA-70b-rope8-32k-fp16](https://huggingface.co/grimulkan/lzlv-longLORA-70b-rope8-32k-fp16)