pszemraj autoevaluator HF staff commited on
Commit
92f4b6b
1 Parent(s): 8792e30

Add evaluation results on the samsum config and test split of samsum (#1)

Browse files

- Add evaluation results on the samsum config and test split of samsum (978d8af7d99183d0fd2bb6c49bea2eb1fb03aa54)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -13,6 +13,42 @@ datasets:
13
  metrics:
14
  - rouge
15
  inference: false
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ---
17
 
18
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15
 
13
  metrics:
14
  - rouge
15
  inference: false
16
+ model-index:
17
+ - name: pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15
18
+ results:
19
+ - task:
20
+ type: summarization
21
+ name: Summarization
22
+ dataset:
23
+ name: samsum
24
+ type: samsum
25
+ config: samsum
26
+ split: test
27
+ metrics:
28
+ - name: ROUGE-1
29
+ type: rouge
30
+ value: 24.5482
31
+ verified: true
32
+ - name: ROUGE-2
33
+ type: rouge
34
+ value: 4.811
35
+ verified: true
36
+ - name: ROUGE-L
37
+ type: rouge
38
+ value: 17.2505
39
+ verified: true
40
+ - name: ROUGE-LSUM
41
+ type: rouge
42
+ value: 20.906
43
+ verified: true
44
+ - name: loss
45
+ type: loss
46
+ value: 3.3002164363861084
47
+ verified: true
48
+ - name: gen_len
49
+ type: gen_len
50
+ value: 52.0
51
+ verified: true
52
  ---
53
 
54
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15