Commit
•
108c532
1
Parent(s):
db4c833
Update README.md
Browse files
README.md
CHANGED
|
@@ -74,6 +74,29 @@ Coming soon
|
|
| 74 |
- jondurbin/airoboros-3.2
|
| 75 |
- microsoft/orca-math-word-problems-200k
|
| 76 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 77 |
|
| 78 |
#### Training Hyperparameters
|
| 79 |
|
|
|
|
| 74 |
- jondurbin/airoboros-3.2
|
| 75 |
- microsoft/orca-math-word-problems-200k
|
| 76 |
|
| 77 |
+
## Evaluations
|
| 78 |
+
|
| 79 |
+
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
| 80 |
+
|---------------------------------|-------|------|-----:|--------|-----:|---|-----:|
|
| 81 |
+
|agieval_nous |N/A |none | 0|acc |0.2537|± |0.0086|
|
| 82 |
+
| | |none | 0|acc_norm|0.2474|± |0.0085|
|
| 83 |
+
| - agieval_aqua_rat | 1|none | 0|acc |0.2283|± |0.0264|
|
| 84 |
+
| | |none | 0|acc_norm|0.2441|± |0.0270|
|
| 85 |
+
| - agieval_logiqa_en | 1|none | 0|acc |0.2750|± |0.0175|
|
| 86 |
+
| | |none | 0|acc_norm|0.3164|± |0.0182|
|
| 87 |
+
| - agieval_lsat_ar | 1|none | 0|acc |0.2087|± |0.0269|
|
| 88 |
+
| | |none | 0|acc_norm|0.1739|± |0.0250|
|
| 89 |
+
| - agieval_lsat_lr | 1|none | 0|acc |0.1843|± |0.0172|
|
| 90 |
+
| | |none | 0|acc_norm|0.2353|± |0.0188|
|
| 91 |
+
| - agieval_lsat_rc | 1|none | 0|acc |0.2602|± |0.0268|
|
| 92 |
+
| | |none | 0|acc_norm|0.1784|± |0.0234|
|
| 93 |
+
| - agieval_sat_en | 1|none | 0|acc |0.3544|± |0.0334|
|
| 94 |
+
| | |none | 0|acc_norm|0.2961|± |0.0319|
|
| 95 |
+
| - agieval_sat_en_without_passage| 1|none | 0|acc |0.3107|± |0.0323|
|
| 96 |
+
| | |none | 0|acc_norm|0.2282|± |0.0293|
|
| 97 |
+
| - agieval_sat_math | 1|none | 0|acc |0.2727|± |0.0301|
|
| 98 |
+
| | |none | 0|acc_norm|0.2091|± |0.0275|
|
| 99 |
+
|truthfulqa_mc2 | 2|none | 0|acc |0.3923|± |0.0139|
|
| 100 |
|
| 101 |
#### Training Hyperparameters
|
| 102 |
|