abacusai
/

Smaug-Llama-3-70B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ArkaAbacus commited on Jun 3

Commit

5af6f9d

•

1 Parent(s): 6add7be

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -135,7 +135,7 @@ Meta-Llama-3-70B-Instruct           9.006250
 | Model | ARC  | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K* |
 | :---- | ---: | ------:   | ---: | ---:       | ---:       | ---:   |
-| Smaug-Llama-3-70B-Instruct | 70.5 | 86.1 | 79.2 | 62.5 | 83.5 | 90.5 |
 | Llama-3-70B-Instruct | 71.4 | 85.7 | 80.0 | 61.8 | 82.9 | 91.1 |
 **GSM8K** The GSM8K numbers quoted here are computed using a recent release

 | Model | ARC  | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K* |
 | :---- | ---: | ------:   | ---: | ---:       | ---:       | ---:   |
+| Smaug-Llama-3-70B-Instruct | 70.6 | 86.1 | 79.2 | 62.5 | 83.5 | 90.5 |
 | Llama-3-70B-Instruct | 71.4 | 85.7 | 80.0 | 61.8 | 82.9 | 91.1 |
 **GSM8K** The GSM8K numbers quoted here are computed using a recent release