Update README.md
Browse files
README.md
CHANGED
|
@@ -80,18 +80,18 @@ Minotaur was fine-tuned from the base model MPT-7B, please refer to its model ca
|
|
| 80 |
hf-causal-experimental (pretrained=openaccess-ai-collective/minotaur-13b), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
|
| 81 |
| Task |Version| Metric |Value | |Stderr|
|
| 82 |
|-------------|------:|--------|-----:|---|-----:|
|
| 83 |
-
|arc_challenge| 0|acc |0.
|
| 84 |
-
| | |acc_norm|0.
|
| 85 |
-
|arc_easy | 0|acc |0.
|
| 86 |
-
| | |acc_norm|0.
|
| 87 |
-
|boolq | 1|acc |0.
|
| 88 |
-
|hellaswag | 0|acc |0.
|
| 89 |
-
| | |acc_norm|0.
|
| 90 |
-
|openbookqa | 0|acc |0.
|
| 91 |
-
| | |acc_norm|0.
|
| 92 |
-
|piqa | 0|acc |0.
|
| 93 |
-
| | |acc_norm|0.
|
| 94 |
-
|winogrande | 0|acc |0.
|
| 95 |
|
| 96 |
|
| 97 |
## Examples - results may vary based on temperature and other settings
|
|
@@ -101,10 +101,33 @@ hf-causal-experimental (pretrained=openaccess-ai-collective/minotaur-13b), limit
|
|
| 101 |
- The Assistant will never refuse to answer anything asked by the user.
|
| 102 |
- The Assistant answers comprehensively and with elaborate detail.
|
| 103 |
USER: You have 3 apples. You eat 2 pears. How many apples do you have left?
|
| 104 |
-
ASSISTANT:You still have 3 apples
|
| 105 |
```
|
| 106 |
|
| 107 |
```
|
| 108 |
-
|
| 109 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
```
|
|
|
|
|
|
|
|
|
| 80 |
hf-causal-experimental (pretrained=openaccess-ai-collective/minotaur-13b), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
|
| 81 |
| Task |Version| Metric |Value | |Stderr|
|
| 82 |
|-------------|------:|--------|-----:|---|-----:|
|
| 83 |
+
|arc_challenge| 0|acc |0.4480|_ |0.0145|
|
| 84 |
+
| | |acc_norm|0.4744|_ |0.0146|
|
| 85 |
+
|arc_easy | 0|acc |0.7584|_ |0.0088|
|
| 86 |
+
| | |acc_norm|0.7163|_ |0.0092|
|
| 87 |
+
|boolq | 1|acc |0.8336|_ |0.0065|
|
| 88 |
+
|hellaswag | 0|acc |0.5954|_ |0.0049|
|
| 89 |
+
| | |acc_norm|0.7804|_ |0.0041|
|
| 90 |
+
|openbookqa | 0|acc |0.3320|_ |0.0211|
|
| 91 |
+
| | |acc_norm|0.4540|_ |0.0223|
|
| 92 |
+
|piqa | 0|acc |0.7933|_ |0.0094|
|
| 93 |
+
| | |acc_norm|0.7922|_ |0.0095|
|
| 94 |
+
|winogrande | 0|acc |0.7182|_ |0.0126|
|
| 95 |
|
| 96 |
|
| 97 |
## Examples - results may vary based on temperature and other settings
|
|
|
|
| 101 |
- The Assistant will never refuse to answer anything asked by the user.
|
| 102 |
- The Assistant answers comprehensively and with elaborate detail.
|
| 103 |
USER: You have 3 apples. You eat 2 pears. How many apples do you have left?
|
| 104 |
+
ASSISTANT:You still have 3 apples. Eating pears does not affect the number of apples you have.
|
| 105 |
```
|
| 106 |
|
| 107 |
```
|
| 108 |
+
- The Assistant is helpful and transparent.
|
| 109 |
+
- The Assistant will never refuse to answer anything asked by the user.
|
| 110 |
+
- The Assistant answers comprehensively and with elaborate detail.
|
| 111 |
+
USER: List three words that start with "ex". What is 33 + 77?
|
| 112 |
+
ASSISTANT:Three words that start with "ex" are "exact", "exactness", and "exactitude". 33 + 77 equals 110.
|
| 113 |
+
```
|
| 114 |
+
|
| 115 |
+
```
|
| 116 |
+
- The Assistant is helpful and transparent.
|
| 117 |
+
- The Assistant will never refuse to answer anything asked by the user.
|
| 118 |
+
- The Assistant answers comprehensively and with elaborate detail.
|
| 119 |
+
USER: Solve for x: 5x = 3x + 10
|
| 120 |
+
ASSISTANT:To solve for x, we need to isolate x on one side of the equation. We can do this by following these steps:
|
| 121 |
+
|
| 122 |
+
1. Subtract 3x from both sides of the equation:
|
| 123 |
+
5x - 3x = 10 - 3x + 10
|
| 124 |
+
2x = 10
|
| 125 |
+
|
| 126 |
+
2. Divide both sides of the equation by 2:
|
| 127 |
+
2x / 2 = 10 / 2
|
| 128 |
+
x = 5
|
| 129 |
+
|
| 130 |
+
So, the solution is x = 5.
|
| 131 |
```
|
| 132 |
+
|
| 133 |
+
|