Text Generation
Transformers
PyTorch
Safetensors
English
gpt2
Inference Endpoints
text-generation-inference
lgaalves commited on
Commit
135a2a5
1 Parent(s): c814f93

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -18,11 +18,11 @@ pipeline_tag: text-generation
18
 
19
  | Metric | gpt2_guanaco-dolly-platypus | GPT-2 (base) |
20
  |-----------------------|-------|-------|
21
- | Avg. | - | 29.9 |
22
- | ARC (25-shot) | - | 21.84 |
23
- | HellaSwag (10-shot) | - | 31.6 |
24
- | MMLU (5-shot) | - | 25.86 |
25
- | TruthfulQA (0-shot) | - | 40.67 |
26
 
27
 
28
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
 
18
 
19
  | Metric | gpt2_guanaco-dolly-platypus | GPT-2 (base) |
20
  |-----------------------|-------|-------|
21
+ | Avg. | **30.25** | 29.9 |
22
+ | ARC (25-shot) | **23.55** | 21.84 |
23
+ | HellaSwag (10-shot) | 31.03 | **31.6** |
24
+ | MMLU (5-shot) | **26.4** | 25.86 |
25
+ | TruthfulQA (0-shot) | 40.02 | **40.67** |
26
 
27
 
28
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.