abacusai
/

Smaug-Llama-3-70B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

arvindabacus commited on May 19

Commit

121b41e

•

1 Parent(s): 1719e62

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -87,6 +87,7 @@ Score vs selected others (sourced from: (https://lmsys.org/blog/2024-04-19-arena
 | Model | Score | 95% Confidence Interval | Average Tokens |
 | :---- | ---------: | ----------: | ------: |
 | GPT-4-Turbo-2024-04-09 | 82.6  | (-1.8, 1.6)  | 662 |
 | Claude-3-Opus-20240229 | 60.4  | (-3.3, 2.4)  | 541 |
 | Gemini-1.5-pro-latest | 72.1  | (-2.3, 2.2)  | 630 |
 | **Smaug-Llama-3-70B-Instruct** | 56.7  | (-2.2, 2.6)  | 661 |

 | Model | Score | 95% Confidence Interval | Average Tokens |
 | :---- | ---------: | ----------: | ------: |
 | GPT-4-Turbo-2024-04-09 | 82.6  | (-1.8, 1.6)  | 662 |
+| GPT-4o | 78.3  | (-2.4, 2.1)  | 685 |
 | Claude-3-Opus-20240229 | 60.4  | (-3.3, 2.4)  | 541 |
 | Gemini-1.5-pro-latest | 72.1  | (-2.3, 2.2)  | 630 |
 | **Smaug-Llama-3-70B-Instruct** | 56.7  | (-2.2, 2.6)  | 661 |