philschmid HF staff autoevaluator HF staff commited on
Commit
807745b
1 Parent(s): 38a5b89

Add evaluation results on samsum dataset (#1)

Browse files

- Add evaluation results on samsum dataset (1641ce08c58858b7757e7006f8e90afab049ae7b)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +41 -7
README.md CHANGED
@@ -9,13 +9,47 @@ license: apache-2.0
9
  datasets:
10
  - samsum
11
  widget:
12
- - text: |
13
- Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker?
14
- Philipp: Sure you can use the new Hugging Face Deep Learning Container.
15
- Jeff: ok.
16
- Jeff: and how can I get started?
17
- Jeff: where can I find documentation?
18
- Philipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ---
20
 
21
  ## `bart-base-samsum`
9
  datasets:
10
  - samsum
11
  widget:
12
+ - text: "Jeff: Can I train a \U0001F917 Transformers model on Amazon SageMaker? \n\
13
+ Philipp: Sure you can use the new Hugging Face Deep Learning Container. \nJeff:\
14
+ \ ok.\nJeff: and how can I get started? \nJeff: where can I find documentation?\
15
+ \ \nPhilipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face\
16
+ \ "
17
+ model-index:
18
+ - name: philschmid/bart-base-samsum
19
+ results:
20
+ - task:
21
+ type: summarization
22
+ name: Summarization
23
+ dataset:
24
+ name: samsum
25
+ type: samsum
26
+ config: samsum
27
+ split: test
28
+ metrics:
29
+ - name: ROUGE-1
30
+ type: rouge
31
+ value: 45.3438
32
+ verified: true
33
+ - name: ROUGE-2
34
+ type: rouge
35
+ value: 21.6953
36
+ verified: true
37
+ - name: ROUGE-L
38
+ type: rouge
39
+ value: 38.1365
40
+ verified: true
41
+ - name: ROUGE-LSUM
42
+ type: rouge
43
+ value: 41.5913
44
+ verified: true
45
+ - name: loss
46
+ type: loss
47
+ value: 1.5832244157791138
48
+ verified: true
49
+ - name: gen_len
50
+ type: gen_len
51
+ value: 17.9927
52
+ verified: true
53
  ---
54
 
55
  ## `bart-base-samsum`