Commit
•
9fc81d7
1
Parent(s):
00ec376
Update README.md
Browse files
README.md
CHANGED
|
@@ -96,5 +96,27 @@ def quick_sort(arr):
|
|
| 96 |
## Metrics
|
| 97 |
|
| 98 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 99 |
|
|
|
|
|
|
|
|
|
|
| 100 |
```
|
|
|
|
| 96 |
## Metrics
|
| 97 |
|
| 98 |
```
|
| 99 |
+
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
| 100 |
+
|---------|-------|------|-----:|--------|-----:|---|-----:|
|
| 101 |
+
|hellaswag|Yaml |none | 0|acc |0.4974|± |0.0050|
|
| 102 |
+
| | |none | 0|acc_norm|0.6600|± |0.0047|
|
| 103 |
+
| Groups |Version|Filter|n-shot| Metric | Value | |Stderr|
|
| 104 |
+
|----------|-------|------|-----:|-----------|-------:|---|-----:|
|
| 105 |
+
|truthfulqa|N/A |none | 0|bleu_max | 23.5771|± |0.5407|
|
| 106 |
+
| | |none | 0|bleu_acc | 0.2754|± |0.0002|
|
| 107 |
+
| | |none | 0|bleu_diff | -8.1019|± |0.5137|
|
| 108 |
+
| | |none | 0|rouge1_max | 49.5707|± |0.6501|
|
| 109 |
+
| | |none | 0|rouge1_acc | 0.2607|± |0.0002|
|
| 110 |
+
| | |none | 0|rouge1_diff| -9.8962|± |0.5492|
|
| 111 |
+
| | |none | 0|rouge2_max | 33.0399|± |0.8237|
|
| 112 |
+
| | |none | 0|rouge2_acc | 0.2313|± |0.0002|
|
| 113 |
+
| | |none | 0|rouge2_diff|-11.9054|± |0.7963|
|
| 114 |
+
| | |none | 0|rougeL_max | 46.3168|± |0.6705|
|
| 115 |
+
| | |none | 0|rougeL_acc | 0.2521|± |0.0002|
|
| 116 |
+
| | |none | 0|rougeL_diff|-10.1301|± |0.5669|
|
| 117 |
+
| | |none | 0|acc | 0.3191|± |0.0405|
|
| 118 |
|
| 119 |
+
| Tasks |Version|Filter|n-shot|Metric|Value | |Stderr|
|
| 120 |
+
|----------|-------|------|-----:|------|-----:|---|-----:|
|
| 121 |
+
|winogrande|Yaml |none | 0|acc |0.6322|± |0.0136|
|
| 122 |
```
|