ShiveringSpine
/

Euryale-1.4-L2-70B-5.0bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ShiveringSpine commited on Nov 9, 2023

Commit

ed19e2c

•

1 Parent(s): 9224d65

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -1,3 +1,7 @@
 ---
 license: llama2
 ---

 ---
 license: llama2
 ---
+exl2 quantization of Sao10K/Euryale-1.4-L2-70B
+I haven't tested perplexity of this, but it seems to work fine compared to Euryale 1.3 5bpw.