ydshieh HF staff autoevaluator HF staff commited on
Commit
cc82caa
1 Parent(s): bdbe6af

Add evaluation results on scientific_papers dataset (#5)

Browse files

- Add evaluation results on scientific_papers dataset (63084607d109ceac888f7f0b400df13c8a8fa8ac)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +40 -1
README.md CHANGED
@@ -1,11 +1,50 @@
1
  ---
2
-
3
  language: en
4
  license: apache-2.0
5
  datasets:
6
  - scientific_papers
7
  tags:
8
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  ---
10
 
11
  # BigBirdPegasus model (large)
 
1
  ---
 
2
  language: en
3
  license: apache-2.0
4
  datasets:
5
  - scientific_papers
6
  tags:
7
  - summarization
8
+ model-index:
9
+ - name: google/bigbird-pegasus-large-pubmed
10
+ results:
11
+ - task:
12
+ type: summarization
13
+ name: Summarization
14
+ dataset:
15
+ name: scientific_papers
16
+ type: scientific_papers
17
+ config: pubmed
18
+ split: test
19
+ metrics:
20
+ - name: ROUGE-1
21
+ type: rouge
22
+ value: 40.8966
23
+ verified: true
24
+ - name: ROUGE-2
25
+ type: rouge
26
+ value: 18.1161
27
+ verified: true
28
+ - name: ROUGE-L
29
+ type: rouge
30
+ value: 26.1743
31
+ verified: true
32
+ - name: ROUGE-LSUM
33
+ type: rouge
34
+ value: 34.2773
35
+ verified: true
36
+ - name: loss
37
+ type: loss
38
+ value: 2.1707184314727783
39
+ verified: true
40
+ - name: meteor
41
+ type: meteor
42
+ value: 0.3513
43
+ verified: true
44
+ - name: gen_len
45
+ type: gen_len
46
+ value: 221.2531
47
+ verified: true
48
  ---
49
 
50
  # BigBirdPegasus model (large)