philschmid HF staff autoevaluator HF staff commited on
Commit
3d05f28
1 Parent(s): 01473c6

Add evaluation results on samsum dataset (#1)

Browse files

- Add evaluation results on samsum dataset (09b79fe340dd38f362d80c7392f8886251d42ff8)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +57 -27
README.md CHANGED
@@ -8,41 +8,71 @@ tags:
8
  datasets:
9
  - samsum
10
  widget:
11
- - text: |
12
- Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker?
13
- Philipp: Sure you can use the new Hugging Face Deep Learning Container.
14
- Jeff: ok.
15
- Jeff: and how can I get started?
16
- Jeff: where can I find documentation?
17
- Philipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face
18
  model-index:
19
  - name: bart-large-cnn-samsum
20
  results:
21
- - task:
22
  name: Abstractive Text Summarization
23
  type: abstractive-text-summarization
24
  dataset:
25
- name: "SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization"
26
  type: samsum
27
  metrics:
28
- - name: Validation ROGUE-1
29
- type: rogue-1
30
- value: 42.621
31
- - name: Validation ROGUE-2
32
- type: rogue-2
33
- value: 21.9825
34
- - name: Validation ROGUE-L
35
- type: rogue-l
36
- value: 33.034
37
- - name: Test ROGUE-1
38
- type: rogue-1
39
- value: 41.3174
40
- - name: Test ROGUE-2
41
- type: rogue-2
42
- value: 20.8716
43
- - name: Test ROGUE-L
44
- type: rogue-l
45
- value: 32.1337
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
46
  ---
47
 
48
  ## `bart-large-cnn-samsum`
8
  datasets:
9
  - samsum
10
  widget:
11
+ - text: "Jeff: Can I train a \U0001F917 Transformers model on Amazon SageMaker? \n\
12
+ Philipp: Sure you can use the new Hugging Face Deep Learning Container. \nJeff:\
13
+ \ ok.\nJeff: and how can I get started? \nJeff: where can I find documentation?\
14
+ \ \nPhilipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face\n"
 
 
 
15
  model-index:
16
  - name: bart-large-cnn-samsum
17
  results:
18
+ - task:
19
  name: Abstractive Text Summarization
20
  type: abstractive-text-summarization
21
  dataset:
22
+ name: 'SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization'
23
  type: samsum
24
  metrics:
25
+ - name: Validation ROGUE-1
26
+ type: rogue-1
27
+ value: 42.621
28
+ - name: Validation ROGUE-2
29
+ type: rogue-2
30
+ value: 21.9825
31
+ - name: Validation ROGUE-L
32
+ type: rogue-l
33
+ value: 33.034
34
+ - name: Test ROGUE-1
35
+ type: rogue-1
36
+ value: 41.3174
37
+ - name: Test ROGUE-2
38
+ type: rogue-2
39
+ value: 20.8716
40
+ - name: Test ROGUE-L
41
+ type: rogue-l
42
+ value: 32.1337
43
+ - task:
44
+ type: summarization
45
+ name: Summarization
46
+ dataset:
47
+ name: samsum
48
+ type: samsum
49
+ config: samsum
50
+ split: test
51
+ metrics:
52
+ - name: ROUGE-1
53
+ type: rouge
54
+ value: 41.3282
55
+ verified: true
56
+ - name: ROUGE-2
57
+ type: rouge
58
+ value: 20.8755
59
+ verified: true
60
+ - name: ROUGE-L
61
+ type: rouge
62
+ value: 32.1353
63
+ verified: true
64
+ - name: ROUGE-LSUM
65
+ type: rouge
66
+ value: 38.401
67
+ verified: true
68
+ - name: loss
69
+ type: loss
70
+ value: 1.4297215938568115
71
+ verified: true
72
+ - name: gen_len
73
+ type: gen_len
74
+ value: 60.0757
75
+ verified: true
76
  ---
77
 
78
  ## `bart-large-cnn-samsum`