autoevaluator HF staff commited on
Commit
7552398
1 Parent(s): e609718

Add evaluation results on the default config and test split of xsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config and test split of the [xsum](https://huggingface.co/datasets/xsum) dataset by

@zuzannad1

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-xsum-default-7c65dc-60294145405).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +66 -29
README.md CHANGED
@@ -1,47 +1,84 @@
1
-
2
  ---
3
  language: en
 
4
  tags:
5
  - sagemaker
6
  - bart
7
  - summarization
8
- license: apache-2.0
9
  datasets:
10
  - samsum
 
 
 
 
 
11
  model-index:
12
  - name: bart-large-cnn-samsum
13
  results:
14
- - task:
15
- name: Abstractive Text Summarization
16
  type: abstractive-text-summarization
 
17
  dataset:
18
- name: "SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization"
19
  type: samsum
20
  metrics:
21
- - name: Validation ROGUE-1
22
- type: rogue-1
23
- value: 43.2111
24
- - name: Validation ROGUE-2
25
- type: rogue-2
26
- value: 22.3519
27
- - name: Validation ROGUE-L
28
- type: rogue-l
29
- value: 33.315
30
- - name: Test ROGUE-1
31
- type: rogue-1
32
- value: 41.8283
33
- - name: Test ROGUE-2
34
- type: rogue-2
35
- value: 20.9857
36
- - name: Test ROGUE-L
37
- type: rogue-l
38
- value: 32.3602
39
- widget:
40
- - text: |
41
- Sugi: I am tired of everything in my life.
42
- Tommy: What? How happy you life is! I do envy you.
43
- Sugi: You don't know that I have been over-protected by my mother these years. I am really about to leave the family and spread my wings.
44
- Tommy: Maybe you are right.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
45
  ---
46
  ## `bart-large-cnn-samsum`
47
  This model was trained using Amazon SageMaker and the new Hugging Face Deep Learning container.
 
 
1
  ---
2
  language: en
3
+ license: apache-2.0
4
  tags:
5
  - sagemaker
6
  - bart
7
  - summarization
 
8
  datasets:
9
  - samsum
10
+ widget:
11
+ - text: "Sugi: I am tired of everything in my life. \nTommy: What? How happy you life\
12
+ \ is! I do envy you.\nSugi: You don't know that I have been over-protected by\
13
+ \ my mother these years. I am really about to leave the family and spread my wings.\n\
14
+ Tommy: Maybe you are right. "
15
  model-index:
16
  - name: bart-large-cnn-samsum
17
  results:
18
+ - task:
 
19
  type: abstractive-text-summarization
20
+ name: Abstractive Text Summarization
21
  dataset:
22
+ name: 'SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization'
23
  type: samsum
24
  metrics:
25
+ - type: rogue-1
26
+ value: 43.2111
27
+ name: Validation ROGUE-1
28
+ - type: rogue-2
29
+ value: 22.3519
30
+ name: Validation ROGUE-2
31
+ - type: rogue-l
32
+ value: 33.315
33
+ name: Validation ROGUE-L
34
+ - type: rogue-1
35
+ value: 41.8283
36
+ name: Test ROGUE-1
37
+ - type: rogue-2
38
+ value: 20.9857
39
+ name: Test ROGUE-2
40
+ - type: rogue-l
41
+ value: 32.3602
42
+ name: Test ROGUE-L
43
+ - task:
44
+ type: summarization
45
+ name: Summarization
46
+ dataset:
47
+ name: xsum
48
+ type: xsum
49
+ config: default
50
+ split: test
51
+ metrics:
52
+ - type: rouge
53
+ value: 21.5288
54
+ name: ROUGE-1
55
+ verified: true
56
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzYyNWVjMjFlYTBhODc5MzU1MjgwZjM4YTlkZmNiOWFhNDhjMDFlMDhkYmIwNWI1MzRmNDM4OWFiN2YyNzc4MyIsInZlcnNpb24iOjF9.jc31m48cpd_2oEqfr_h_N3mJ2EEvyivpNoP_lAeN-QqiJPbT7iWN1RTSzlTMaQjlRTxW3l45-eM9NCbi859eBA
57
+ - type: rouge
58
+ value: 4.3523
59
+ name: ROUGE-2
60
+ verified: true
61
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjkxYjNiZTgxYzUwYTYzN2JhZTZiZDBhNjU0Mjg3N2EyY2M4ZjY0MDI5MDdmMTRjNDljZDI3NjdjMjdiN2NhMyIsInZlcnNpb24iOjF9.-yLkLjyRddLpQRBYndrrHsS71frqLMOy_waw1JixjsofLVGkpeciRQubOjDGd307pe7TasA_IUJwDIr2BSNfBw
62
+ - type: rouge
63
+ value: 14.2343
64
+ name: ROUGE-L
65
+ verified: true
66
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNGMxOGY3ODFhYmIxYjMzMDEwNWFiZmQ1NTAyYzJmNzRiYmM2YjIzMmRkNGY1ZWJhY2UyZDhkZGMwM2Q1ODNlMyIsInZlcnNpb24iOjF9.nzFPJI_6uZZ_8K_n7qt0_OBiMAZh9chekdGqn9xZ_jrQ-ppNVtFZfPweUnpV5JjDAGIzmrxBIi8Y7ci8M13SAA
67
+ - type: rouge
68
+ value: 17.3884
69
+ name: ROUGE-LSUM
70
+ verified: true
71
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWVkMjU3MjAwNzM3MjQ1ZGZiN2RhNGRjNDBlMGE2YTU2NDdjOWU2MDc2NDg0MmI5YTY0NjI4NDc0NTBjZGUzMSIsInZlcnNpb24iOjF9.W4TUCxCvddu21StnHsdwBuNIPB8mBqNVRgSOCg0LNNQoCXFI0eOobUIuYGuliYpka3rBEK2BQC4km7yad-vxAw
72
+ - type: loss
73
+ value: 2.78153133392334
74
+ name: loss
75
+ verified: true
76
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjI4NTk3NWE3YTM0MTZiY2VkYmNhZWU5NWZlZDQ2ZjUxMWM2Y2FiMTk1Y2JmYzBmMmQxMTcxNGRmZWM5ZDM0ZSIsInZlcnNpb24iOjF9.m5UmARkSVyshaDZehFexQgGfUnrZuGvF19MJUjURe7iJlWjpeN8hYtoaa9ym3_0Yc8qykrsTkEIVlM-ft5SjDQ
77
+ - type: gen_len
78
+ value: 73.6503
79
+ name: gen_len
80
+ verified: true
81
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTM5MDYzOWJiZTc0ZThmNDAzODA4NDZmMWY5N2JjZWJiOTkzM2Y3MGZkOWU3NGM4MzdkYjI2ZDQ2ZTg3MWMwMiIsInZlcnNpb24iOjF9.Zy82pW8bQHuFcGxDkzNMt4brNUcY4m18tRHieISKVQ77Z7UymFzJ19yW_2MP-ONJv6X2zkTsyUoZDhZ3OYSeBw
82
  ---
83
  ## `bart-large-cnn-samsum`
84
  This model was trained using Amazon SageMaker and the new Hugging Face Deep Learning container.