Panchovix
/

airoboros-l2-70b-gpt4-1.4.1_4bit-bpw_variants_h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Panchovix commited on Sep 21, 2023

Commit

43f0f6b

•

1 Parent(s): d4cc271

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -7,5 +7,4 @@ You can find 4.25bpw (main branch), 4.5bpw and 4.75bpw in each branch.
 Update 21/09/2023
-Re-quanted the 4.25 and 4.5 variants with latest exllamav2 version, which fixed some measurement issues.
-4.75 variant is on process.


7
8	Update 21/09/2023
9
10	+ Re-quanted all variants with latest exllamav2 version, which fixed some measurement issues.