DavidAU commited on
Commit
5bee87d
1 Parent(s): 6daf20e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+ <h3> Experimental running Quants of "Dark Sapling V2 7B Ultra Quality" (32k context) in Imatrix Plus 2 and Imatrix X protocols. </h3>
5
+
6
+ Imatrix Plus 2 is an advanced Imatrix quanting method using multiple datasets.
7
+
8
+ Imatrix X takes Imatrix Plus 2 a step further and introduces a "pass-through merge" method between Imatrix Plus 2 and regular Quants.
9
+
10
+ This leverages the full power of both Imatrix Plus 2 and regular quant (which is based on Ultra Quality 32 bit precision).
11
+
12
+ Imatrix Plus 2 and Imatrix X are the next steps in Ultra Quality experience.
13
+
14
+ The quants hosted here are various versions of "Imatrix X" (with Imatrix Plus 2), with the exception of
15
+ "DarkSapling-V2-Ultra-Quality-7B-Q4_k_m-imat1.gguf" which is stand alone Imatrix Plus 2.
16
+
17
+ All quants operate, however there is more work in progress and these quants are subject to revision without notice.
18
+
19
+ For testing purposes (if you download more than one) set "TEMP:0" and test your prompt(s).
20
+
21
+ You should use prompts with "no right answer" to fully evalute the quant (and vs other quants here).
22
+
23
+ Not all of these quants are suitable for all purposes and protocol(s) are still under developement.
24
+
25
+ Although these are all "Q4_K_M Imatrix 2" quants they differ greatly due to Imatrix X protocols.
26
+
27
+ Caution: Can generate NSFW content.
28
+
29
+ For more information on Dark Sapling V2 Ultra Quality please see:
30
+
31
+ [ https://huggingface.co/DavidAU/DarkSapling-V2-Ultra-Quality-7B-GGUF ]