lewtun HF staff commited on
Commit
8ed204c
1 Parent(s): 623321f

Add evaluation results on the plain_text config and validation split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and validation split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by @nonchalant-nagavalli, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-launch__gov_report-plain_text-7b7f8a-16126220).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +36 -1
README.md CHANGED
@@ -1,11 +1,46 @@
1
  ---
2
-
3
  language: en
4
  license: apache-2.0
5
  datasets:
6
  - big_patent
7
  tags:
8
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  ---
10
 
11
  # BigBirdPegasus model (large)
1
  ---
 
2
  language: en
3
  license: apache-2.0
4
  datasets:
5
  - big_patent
6
  tags:
7
  - summarization
8
+ model-index:
9
+ - name: google/bigbird-pegasus-large-bigpatent
10
+ results:
11
+ - task:
12
+ type: summarization
13
+ name: Summarization
14
+ dataset:
15
+ name: launch/gov_report
16
+ type: launch/gov_report
17
+ config: plain_text
18
+ split: validation
19
+ metrics:
20
+ - name: ROUGE-1
21
+ type: rouge
22
+ value: 25.7406
23
+ verified: true
24
+ - name: ROUGE-2
25
+ type: rouge
26
+ value: 5.3193
27
+ verified: true
28
+ - name: ROUGE-L
29
+ type: rouge
30
+ value: 17.0878
31
+ verified: true
32
+ - name: ROUGE-LSUM
33
+ type: rouge
34
+ value: 22.5391
35
+ verified: true
36
+ - name: loss
37
+ type: loss
38
+ value: 4.078773021697998
39
+ verified: true
40
+ - name: gen_len
41
+ type: gen_len
42
+ value: 176.7156
43
+ verified: true
44
  ---
45
 
46
  # BigBirdPegasus model (large)