Hugging Face's logo

grimulkan
/
lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2

Text Generation
Transformers
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1
lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2 / README.md
grimulkan's picture
grimulkan
Update README.md
69657e9 verified
preview code
|
raw
history blame
No virus
167 Bytes
metadata
license: cc-by-2.0

This is an EXL2 6-bit quantization of lzlv-longLORA-70b-rope8-32k-fp16