grimulkan
/

lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

grimulkan commited on Jan 22

Commit

69657e9

•

1 Parent(s): 3f3efea

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -1,3 +1,5 @@
 ---
 license: cc-by-2.0
 ---

 ---
 license: cc-by-2.0
 ---
+This is an EXL2 6-bit quantization of [lzlv-longLORA-70b-rope8-32k-fp16](https://huggingface.co/grimulkan/lzlv-longLORA-70b-rope8-32k-fp16)