Text Generation
Transformers
PyTorch
English
gpt2a
custom_code
crumb commited on
Commit
3f3039f
·
1 Parent(s): bd7acf5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -10,6 +10,9 @@ language:
10
 
11
 
12
  ### Open LLM Leaderboard Average Score: 0.3057
 
 
 
13
  | Task |Version| Metric |Value | |Stderr|
14
  |-------------|------:|--------|-----:|---|-----:|
15
  |arc_challenge| 0|acc |0.1741|± |0.0111|
 
10
 
11
 
12
  ### Open LLM Leaderboard Average Score: 0.3057
13
+
14
+ This is just above base gpt2 only because of truthfulqa score bringing the average up, it has a higher truthfulqa score than any base gpt2 model. It is also just under pythia-160m for average score (0.01%) and
15
+
16
  | Task |Version| Metric |Value | |Stderr|
17
  |-------------|------:|--------|-----:|---|-----:|
18
  |arc_challenge| 0|acc |0.1741|± |0.0111|