abacusai
/

Smaug-Llama-3-70B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ArkaAbacus commited on Jun 3

Commit

6add7be

•

1 Parent(s): 629d716

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -136,7 +136,7 @@ Meta-Llama-3-70B-Instruct           9.006250
 | Model | ARC  | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K* |
 | :---- | ---: | ------:   | ---: | ---:       | ---:       | ---:   |
 | Smaug-Llama-3-70B-Instruct | 70.5 | 86.1 | 79.2 | 62.5 | 83.5 | 90.5 |
-| Llama-3-70B-Instruct | 71.4 | 85.7 | 80.1 | 61.8 | 82.9 | 91.1 |
 **GSM8K** The GSM8K numbers quoted here are computed using a recent release
 of the [LM Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness/).

 | Model | ARC  | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K* |
 | :---- | ---: | ------:   | ---: | ---:       | ---:       | ---:   |
 | Smaug-Llama-3-70B-Instruct | 70.5 | 86.1 | 79.2 | 62.5 | 83.5 | 90.5 |
+| Llama-3-70B-Instruct | 71.4 | 85.7 | 80.0 | 61.8 | 82.9 | 91.1 |
 **GSM8K** The GSM8K numbers quoted here are computed using a recent release
 of the [LM Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness/).