upstage
/

Llama-2-70b-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

wonhosong commited on Jul 24, 2023

Commit

4cc74e8

•

1 Parent(s): f1758fb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -66,8 +66,8 @@ We used the [lm-evaluation-harness repository](https://github.com/EleutherAI/lm-
 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
 | Llama-2-70b-instruct-1024 (***Ours***, ***Local Reproduction***) | **72.0** | **70.7** | **87.4** | **69.3** | **60.7** |
-| Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | 69.8 | 44.9 |
 | llama-65b-instruct (***Ours***, ***Local Reproduction***) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
 | llama-30b-instruct-2048 (***Ours***, ***Open LLM Leaderboard***) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 |
 | Llama-2-70b-chat-hf | 66.8 | 64.6 | 85.9 | 63.9 | 52.8 |
 | llama-30b-instruct (***Ours***, ***Open LLM Leaderboard***) | 65.2 | 62.5 | 86.2 | 59.4 | 52.8 |

 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
 | Llama-2-70b-instruct-1024 (***Ours***, ***Local Reproduction***) | **72.0** | **70.7** | **87.4** | **69.3** | **60.7** |
 | llama-65b-instruct (***Ours***, ***Local Reproduction***) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
+| Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | 69.8 | 44.9 |
 | llama-30b-instruct-2048 (***Ours***, ***Open LLM Leaderboard***) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 |
 | Llama-2-70b-chat-hf | 66.8 | 64.6 | 85.9 | 63.9 | 52.8 |
 | llama-30b-instruct (***Ours***, ***Open LLM Leaderboard***) | 65.2 | 62.5 | 86.2 | 59.4 | 52.8 |