Update README.md
Browse files
README.md
CHANGED
|
@@ -60,6 +60,21 @@ pipeline_tag: text-generation
|
|
| 60 |
|Abel-7B-002 | 80.4 | 29.5 |
|
| 61 |
| **WizardMath-7B-V1.1** | **83.2** | **33.0** |
|
| 62 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 63 |
🔥
|
| 64 |
❗<b>Note for model system prompts usage:</b>
|
| 65 |
|
|
|
|
| 60 |
|Abel-7B-002 | 80.4 | 29.5 |
|
| 61 |
| **WizardMath-7B-V1.1** | **83.2** | **33.0** |
|
| 62 |
|
| 63 |
+
|
| 64 |
+
## [12/19/2023] Comparing WizardMath-7B-V1.1 with large open source (30B~70B) size math LLMs.
|
| 65 |
+
|
| 66 |
+
| Model | GSM8k Pass@1 | MATH Pass@1 |
|
| 67 |
+
| ----- |------| ---- |
|
| 68 |
+
| Llemma-34B | 51.5 | 25.0 |
|
| 69 |
+
| Minerva-62B | 52.4 | 27.6 |
|
| 70 |
+
| DeepSeek 67B | 63.4 | -- |
|
| 71 |
+
| MAmmoTH-70B | 72.4 | 21.1 |
|
| 72 |
+
| Yi-34B | 67.9 | 15.9 |
|
| 73 |
+
| Mixtral 8x7B | 74.4 | 28.4 |
|
| 74 |
+
| MetaMath-70B | 82.3 | 26.6 |
|
| 75 |
+
| **WizardMath-7B-V1.1** | **83.2** | **33.0** |
|
| 76 |
+
|
| 77 |
+
|
| 78 |
🔥
|
| 79 |
❗<b>Note for model system prompts usage:</b>
|
| 80 |
|