philschmid HF staff autoevaluator HF staff commited on
Commit
1968504
1 Parent(s): 176f748

Add evaluation results on samsum dataset (#1)

Browse files

- Add evaluation results on samsum dataset (ce9fb19a8294e4f2110e8fabc2c416281f6576eb)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +40 -7
README.md CHANGED
@@ -9,13 +9,46 @@ license: apache-2.0
9
  datasets:
10
  - samsum
11
  widget:
12
- - text: |
13
- Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker?
14
- Philipp: Sure you can use the new Hugging Face Deep Learning Container.
15
- Jeff: ok.
16
- Jeff: and how can I get started?
17
- Jeff: where can I find documentation?
18
- Philipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ---
20
 
21
  ## `distilbart-cnn-12-6-samsum`
9
  datasets:
10
  - samsum
11
  widget:
12
+ - text: "Jeff: Can I train a \U0001F917 Transformers model on Amazon SageMaker? \n\
13
+ Philipp: Sure you can use the new Hugging Face Deep Learning Container. \nJeff:\
14
+ \ ok.\nJeff: and how can I get started? \nJeff: where can I find documentation?\
15
+ \ \nPhilipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face "
16
+ model-index:
17
+ - name: philschmid/distilbart-cnn-12-6-samsum
18
+ results:
19
+ - task:
20
+ type: summarization
21
+ name: Summarization
22
+ dataset:
23
+ name: samsum
24
+ type: samsum
25
+ config: samsum
26
+ split: test
27
+ metrics:
28
+ - name: ROUGE-1
29
+ type: rouge
30
+ value: 41.0895
31
+ verified: true
32
+ - name: ROUGE-2
33
+ type: rouge
34
+ value: 20.7459
35
+ verified: true
36
+ - name: ROUGE-L
37
+ type: rouge
38
+ value: 31.5952
39
+ verified: true
40
+ - name: ROUGE-LSUM
41
+ type: rouge
42
+ value: 38.3389
43
+ verified: true
44
+ - name: loss
45
+ type: loss
46
+ value: 1.4566329717636108
47
+ verified: true
48
+ - name: gen_len
49
+ type: gen_len
50
+ value: 59.6032
51
+ verified: true
52
  ---
53
 
54
  ## `distilbart-cnn-12-6-samsum`