Update README.md
Browse files
README.md
CHANGED
|
@@ -31,6 +31,17 @@ Training: Axolotl을 이용해 LoRA-8bit로 4epoch 학습 시켰습니다.
|
|
| 31 |
|
| 32 |
### Evaluation
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
| Tasks |n-shot| Metric |Value | |Stderr|
|
| 35 |
|----------------|-----:|--------|-----:|---|------|
|
| 36 |
|kobest_boolq | 5|acc |0.7123|± |0.0121|
|
|
|
|
| 31 |
|
| 32 |
### Evaluation
|
| 33 |
|
| 34 |
+
- 0 shot kobest
|
| 35 |
+
| Tasks |n-shot| Metric |Value | |Stderr|
|
| 36 |
+
|----------------|-----:|--------|-----:|---|------|
|
| 37 |
+
|kobest_boolq | 0|acc |0.5021|± |0.0133|
|
| 38 |
+
|kobest_copa | 0|acc |0.6920|± |0.0146|
|
| 39 |
+
|kobest_hellaswag| 0|acc |0.4520|± |0.0223|
|
| 40 |
+
|kobest_sentineg | 0|acc |0.7330|± |0.0222|
|
| 41 |
+
|kobest_wic | 0|acc |0.4881|± |0.0141|
|
| 42 |
+
|
| 43 |
+
|
| 44 |
+
- 5 shot kobest
|
| 45 |
| Tasks |n-shot| Metric |Value | |Stderr|
|
| 46 |
|----------------|-----:|--------|-----:|---|------|
|
| 47 |
|kobest_boolq | 5|acc |0.7123|± |0.0121|
|