Update README.md
Browse files
README.md
CHANGED
|
@@ -20,8 +20,8 @@ And good news, it lowers the perplexity by :
|
|
| 20 |
|
| 21 |
More than 3% with linear rope 8 on Q2_K
|
| 22 |
|
| 23 |
-
WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant-AR-b1924-Q2_K.gguf,-,wikitext,6.2489,512
|
| 24 |
-
WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant-AR-b1924-iMat-c32_ch25-Q2_K.gguf,-,wikitext,6.0482,512
|
| 25 |
|
| 26 |
More than 2% with linear ropee 4 on Q2_K
|
| 27 |
|
|
@@ -40,6 +40,9 @@ WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant-AR-b1924-iMat-c32_ch25-Q3_K_S.ggu
|
|
| 40 |
|
| 41 |
A Q3_K_M with iMatrix has been added as well, and a Q2_K_S is otw.
|
| 42 |
|
|
|
|
|
|
|
|
|
|
| 43 |
-----
|
| 44 |
|
| 45 |
Interestingly, linear rope 2.5 (and linear rope 1.6 as well after further testing) is almost without loss compared to linear rope 2, while 3 and 3.2 are quite good. Here are the values with the normal Q2_K :
|
|
|
|
| 20 |
|
| 21 |
More than 3% with linear rope 8 on Q2_K
|
| 22 |
|
| 23 |
+
- WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant-AR-b1924-Q2_K.gguf,-,wikitext,6.2489,512
|
| 24 |
+
- WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant-AR-b1924-iMat-c32_ch25-Q2_K.gguf,-,wikitext,6.0482,512
|
| 25 |
|
| 26 |
More than 2% with linear ropee 4 on Q2_K
|
| 27 |
|
|
|
|
| 40 |
|
| 41 |
A Q3_K_M with iMatrix has been added as well, and a Q2_K_S is otw.
|
| 42 |
|
| 43 |
+
Rope 2.5 :
|
| 44 |
+
WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant-AR-b1924-iMat-c32_ch25-Q2_K_S.gguf,-,wikitext,4.6789,512
|
| 45 |
+
|
| 46 |
-----
|
| 47 |
|
| 48 |
Interestingly, linear rope 2.5 (and linear rope 1.6 as well after further testing) is almost without loss compared to linear rope 2, while 3 and 3.2 are quite good. Here are the values with the normal Q2_K :
|