Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,19 @@ Prompts tested with "temp=0" to ensure compliance, 2048 context (model supports
|
|
| 26 |
|
| 27 |
Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
<B> Model Notes: </B>
|
| 30 |
|
| 31 |
Maximum context is 128k. CommandR requires a specific template for usage.
|
|
|
|
| 26 |
|
| 27 |
Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
|
| 28 |
|
| 29 |
+
PPL notes:
|
| 30 |
+
|
| 31 |
+
Original Q2k (generated from source files):
|
| 32 |
+
|
| 33 |
+
PPL = 7.8446 +/- 0.05160
|
| 34 |
+
|
| 35 |
+
New Imatrix NEO V1 Q2K:
|
| 36 |
+
|
| 37 |
+
PPL = 7.4056 +/- 0.04940
|
| 38 |
+
|
| 39 |
+
A 4390 point drop. (lower is better)
|
| 40 |
+
|
| 41 |
+
|
| 42 |
<B> Model Notes: </B>
|
| 43 |
|
| 44 |
Maximum context is 128k. CommandR requires a specific template for usage.
|