Hugging Face's logo

lgaalves
/
gpt2_platypus-dolly-guanaco

Text Generation
Transformers
PyTorch
Safetensors
English
gpt2
text-generation-inference
Inference Endpoints
Model card Files Community
2
lgaalves commited on
Commit
ca9cf38
•
1 Parent(s): 96fcc4f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -18,11 +18,12 @@ pipeline_tag: text-generation
18
 
19
  | Metric | gpt2_platypus-dolly-guanaco | GPT-2 (base) |
20
  |-----------------------|-------|-------|
21
- | Avg. | - | 29.9 |
22
- | ARC (25-shot) | - | 21.84 |
23
- | HellaSwag (10-shot) | - | 31.6 |
24
- | MMLU (5-shot) | - | 25.86 |
25
- | TruthfulQA (0-shot) | - | 40.67 |
 
26
 
27
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
28
 
 
18
 
19
  | Metric | gpt2_platypus-dolly-guanaco | GPT-2 (base) |
20
  |-----------------------|-------|-------|
21
+ | Avg. | 30.18 | 29.9 |
22
+ | ARC (25-shot) | 23.21 | 21.84 |
23
+ | HellaSwag (10-shot) | 31.04 | 31.6 |
24
+ | MMLU (5-shot) | 26.16 | 25.86 |
25
+ | TruthfulQA (0-shot) | 40.31 | 40.67 |
26
+
27
 
28
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
29