Update README.md
Browse files
README.md
CHANGED
@@ -66,13 +66,16 @@ We used the [lm-evaluation-harness repository](https://github.com/EleutherAI/lm-
|
|
66 |
### Main Results
|
67 |
| Model | Average | ARC | HellaSwag | MMLU | TruthfulQA |
|
68 |
|-----------------------------------------------|---------|-------|-----------|-------|------------|
|
69 |
-
| Llama-2-70b-instruct-
|
|
|
70 |
| llama-65b-instruct (Ours, Local Reproduction) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
|
|
|
71 |
| **llama-30b-instruct-2048** (***Ours***, ***Open LLM Leaderboard***) | **67.0** | **64.9** | **84.9** | **61.9** | **56.3** |
|
72 |
-
|
|
73 |
| llama-30b-instruct (Ours, Open LLM Leaderboard) | 65.2 | 62.5 | 86.2 | 59.4 | 52.8 |
|
|
|
74 |
| falcon-40b-instruct | 63.4 | 61.6 | 84.3 | 55.4 | 52.5 |
|
75 |
-
|
76 |
|
77 |
### Scripts
|
78 |
- Prepare evaluation environments:
|
|
|
66 |
### Main Results
|
67 |
| Model | Average | ARC | HellaSwag | MMLU | TruthfulQA |
|
68 |
|-----------------------------------------------|---------|-------|-----------|-------|------------|
|
69 |
+
| Llama-2-70b-instruct-v2 (Ours, Local Reproduction) | 72.7 | 71.6 | 87.7 | 69.7 | 61.6 |
|
70 |
+
| Llama-2-70b-instruct (Ours, Local Reproduction) | 72.0 | 70.7 | 87.4 | 69.3 | 60.7 |
|
71 |
| llama-65b-instruct (Ours, Local Reproduction) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
|
72 |
+
| Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | 69.8 | 44.9 |
|
73 |
| **llama-30b-instruct-2048** (***Ours***, ***Open LLM Leaderboard***) | **67.0** | **64.9** | **84.9** | **61.9** | **56.3** |
|
74 |
+
| **llama-30b-instruct-2048** (***Ours***, ***Local Reproduction***) | **67.0** | **64.9** | **85.0** | **61.9** | **56.0** |
|
75 |
| llama-30b-instruct (Ours, Open LLM Leaderboard) | 65.2 | 62.5 | 86.2 | 59.4 | 52.8 |
|
76 |
+
| llama-65b | 64.2 | 63.5 | 86.1 | 63.9 | 43.4 |
|
77 |
| falcon-40b-instruct | 63.4 | 61.6 | 84.3 | 55.4 | 52.5 |
|
78 |
+
|
79 |
|
80 |
### Scripts
|
81 |
- Prepare evaluation environments:
|