Panchovix
/

airoboros-l2-70b-gpt4-1.4.1_4bit-bpw_variants_h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Panchovix commited on Sep 18, 2023

Commit

6b7a6f4

•

1 Parent(s): 184793e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,6 +3,6 @@ license: other
 ---
 4bit variants quantizations of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1), using exllama2.
-You can find 4.25bpw, 4.5bpw and 4.75bpw in each branch.
 May add 4bpw.

 ---
 4bit variants quantizations of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1), using exllama2.
+You can find 4.25bpw (main branch), 4.5bpw and 4.75bpw in each branch.
 May add 4bpw.