grimulkan
/

lzlv-longLORA-70b-rope8-32k-4bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

lzlv-longLORA-70b-rope8-32k-4bpw-h6-exl2 / README.md

grimulkan's picture

Update README.md

b55f5ce verified 4 months ago

|

history blame contribute delete

No virus

166 Bytes

	---
	license: cc-by-2.0
	---
	This is an EXL2 4-bit quantization of [lzlv-longLORA-70b-rope8-32k-fp16](https://huggingface.co/grimulkan/lzlv-longLORA-70b-rope8-32k-fp16)