Update README.md
Browse files
README.md
CHANGED
@@ -42,7 +42,7 @@ Here's a chart that provides an approximation of the HellaSwag score (out of 1,0
|
|
42 |
|q5_K_M |82.1% |4.8 GiB |4.9 GiB |4.9 GiB |5.1 GiB |5.3 GiB |5.8 GiB |
|
43 |
|q6_K |81.7% |5.6 GiB |5.6 GiB |5.7 GiB |5.8 GiB |6.1 GiB |6.6 GiB |
|
44 |
|
45 |
-
I don't recommend using iq1_S as it gives a BIG drop in quality yet scores worse than lighter models at Q4_K_M like TinyDolphin-
|
46 |
|
47 |
Rest of the quants may be added to the chart later.
|
48 |
|
|
|
42 |
|q5_K_M |82.1% |4.8 GiB |4.9 GiB |4.9 GiB |5.1 GiB |5.3 GiB |5.8 GiB |
|
43 |
|q6_K |81.7% |5.6 GiB |5.6 GiB |5.7 GiB |5.8 GiB |6.1 GiB |6.6 GiB |
|
44 |
|
45 |
+
I don't recommend using iq1_S as it gives a BIG drop in quality yet scores worse than lighter models at Q4_K_M like TinyDolphin-1.1B (HellaSwag: 59.0%) and Dolphin 2.6 Phi-2 (HellaSwag: 71.6%).
|
46 |
|
47 |
Rest of the quants may be added to the chart later.
|
48 |
|