lewtun HF staff commited on
Commit
ad7be7b
1 Parent(s): cb6202a

Add evaluation results on billsum dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [billsum](https://huggingface.co/datasets/billsum) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-e1d72cd6-7845032).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=billsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=billsum).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -3,6 +3,42 @@ license: apache-2.0
3
  datasets: billsum
4
  tags:
5
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  ---
7
 
8
  # Longformer Encoder-Decoder (LED) fine-tuned on Billsum
 
3
  datasets: billsum
4
  tags:
5
  - summarization
6
+ model-index:
7
+ - name: d0r1h/LEDBill
8
+ results:
9
+ - task:
10
+ type: summarization
11
+ name: Summarization
12
+ dataset:
13
+ name: billsum
14
+ type: billsum
15
+ config: default
16
+ split: test
17
+ metrics:
18
+ - name: ROUGE-1
19
+ type: rouge
20
+ value: 38.6502
21
+ verified: true
22
+ - name: ROUGE-2
23
+ type: rouge
24
+ value: 18.5458
25
+ verified: true
26
+ - name: ROUGE-L
27
+ type: rouge
28
+ value: 25.6561
29
+ verified: true
30
+ - name: ROUGE-LSUM
31
+ type: rouge
32
+ value: 33.1575
33
+ verified: true
34
+ - name: loss
35
+ type: loss
36
+ value: 2.1305277347564697
37
+ verified: true
38
+ - name: gen_len
39
+ type: gen_len
40
+ value: 288.372
41
+ verified: true
42
  ---
43
 
44
  # Longformer Encoder-Decoder (LED) fine-tuned on Billsum