Text Generation
Transformers
PyTorch
Safetensors
English
llama
text-generation-inference
Inference Endpoints
lilloukas commited on
Commit
b9f8de0
1 Parent(s): d808028

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -16,11 +16,11 @@ Camel-Platypus2-70B is a merge of [`garage-bAInd/Platypus2-70B`](https://hugging
16
 
17
  | Metric | Value |
18
  |-----------------------|-------|
19
- | MMLU (5-shot) | -- |
20
- | ARC (25-shot) | -- |
21
- | HellaSwag (10-shot) | -- |
22
- | TruthfulQA (0-shot) | -- |
23
- | Avg. | -- |
24
 
25
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
26
 
 
16
 
17
  | Metric | Value |
18
  |-----------------------|-------|
19
+ | MMLU (5-shot) | 69.80 |
20
+ | ARC (25-shot) | 71.16 |
21
+ | HellaSwag (10-shot) | 87.66 |
22
+ | TruthfulQA (0-shot) | 57.77 |
23
+ | Avg. | 71.60 |
24
 
25
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
26