Commit
•
fbe2363
1
Parent(s):
ff7115f
Update README.md
Browse files
README.md
CHANGED
|
@@ -43,5 +43,11 @@ You are Maverick, a helpful AI assistant.<|im_end|>
|
|
| 43 |
|gsm8k| 3|strict-match | 5|exact_match|0.5694|± |0.0136|
|
| 44 |
| | |flexible-extract| 5|exact_match|0.5701|± |0.0136|
|
| 45 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
This model is based on Llama-3-8b, and is governed by [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](LICENSE)
|
|
|
|
| 43 |
|gsm8k| 3|strict-match | 5|exact_match|0.5694|± |0.0136|
|
| 44 |
| | |flexible-extract| 5|exact_match|0.5701|± |0.0136|
|
| 45 |
|
| 46 |
+
## mathqa
|
| 47 |
+
|
| 48 |
+
|Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
| 49 |
+
|------|------:|------|-----:|--------|-----:|---|-----:|
|
| 50 |
+
|mathqa| 1|none | 0|acc |0.3930|± |0.0089|
|
| 51 |
+
| | |none | 0|acc_norm|0.3869|± |0.0089|
|
| 52 |
|
| 53 |
This model is based on Llama-3-8b, and is governed by [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](LICENSE)
|