human-centered-summarization autoevaluator HF staff commited on
Commit
5a1b512
1 Parent(s): 4c7b827

Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (#2)

Browse files

- Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (2876f6f6d18a49e19585f1a82e15088d35ed171d)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +32 -27
README.md CHANGED
@@ -1,27 +1,26 @@
1
  ---
2
  language:
3
  - en
4
- tags:
5
  - summarization
6
  datasets:
7
  - xsum
8
  metrics:
9
  - rouge
10
  widget:
11
- - text: "National Commercial Bank (NCB), Saudi Arabia\u2019s largest lender by assets,\
12
- \ agreed to buy rival Samba Financial Group for $15 billion in the biggest banking\
13
- \ takeover this year.NCB will pay 28.45 riyals ($7.58) for each Samba share, according\
14
- \ to a statement on Sunday, valuing it at about 55.7 billion riyals. NCB will\
15
- \ offer 0.739 new shares for each Samba share, at the lower end of the 0.736-0.787\
16
- \ ratio the banks set when they signed an initial framework agreement in June.The\
17
- \ offer is a 3.5% premium to Samba\u2019s Oct. 8 closing price of 27.50 riyals\
18
- \ and about 24% higher than the level the shares traded at before the talks were\
19
- \ made public. Bloomberg News first reported the merger discussions.The new bank\
20
- \ will have total assets of more than $220 billion, creating the Gulf region\u2019\
21
- s third-largest lender. The entity\u2019s $46 billion market capitalization nearly\
22
- \ matches that of Qatar National Bank QPSC, which is still the Middle East\u2019\
23
- s biggest lender with about $268 billion of assets."
24
-
25
  model-index:
26
  - name: human-centered-summarization/financial-summarization-pegasus
27
  results:
@@ -34,30 +33,36 @@ model-index:
34
  config: default
35
  split: test
36
  metrics:
37
- - name: ROUGE-1
38
- type: rouge
39
  value: 35.2055
 
40
  verified: true
41
- - name: ROUGE-2
42
- type: rouge
43
  value: 16.5689
 
44
  verified: true
45
- - name: ROUGE-L
46
- type: rouge
47
  value: 30.1285
 
48
  verified: true
49
- - name: ROUGE-LSUM
50
- type: rouge
51
  value: 30.1706
 
52
  verified: true
53
- - name: loss
54
- type: loss
55
  value: 2.7092134952545166
 
56
  verified: true
57
- - name: gen_len
58
- type: gen_len
59
  value: 15.1414
 
60
  verified: true
 
61
  ---
62
 
63
  ### PEGASUS for Financial Summarization
 
1
  ---
2
  language:
3
  - en
4
+ tags:
5
  - summarization
6
  datasets:
7
  - xsum
8
  metrics:
9
  - rouge
10
  widget:
11
+ - text: National Commercial Bank (NCB), Saudi Arabia’s largest lender by assets, agreed
12
+ to buy rival Samba Financial Group for $15 billion in the biggest banking takeover
13
+ this year.NCB will pay 28.45 riyals ($7.58) for each Samba share, according to
14
+ a statement on Sunday, valuing it at about 55.7 billion riyals. NCB will offer
15
+ 0.739 new shares for each Samba share, at the lower end of the 0.736-0.787 ratio
16
+ the banks set when they signed an initial framework agreement in June.The offer
17
+ is a 3.5% premium to Samba’s Oct. 8 closing price of 27.50 riyals and about 24%
18
+ higher than the level the shares traded at before the talks were made public.
19
+ Bloomberg News first reported the merger discussions.The new bank will have total
20
+ assets of more than $220 billion, creating the Gulf region’s third-largest lender.
21
+ The entity’s $46 billion market capitalization nearly matches that of Qatar National
22
+ Bank QPSC, which is still the Middle East’s biggest lender with about $268 billion
23
+ of assets.
 
24
  model-index:
25
  - name: human-centered-summarization/financial-summarization-pegasus
26
  results:
 
33
  config: default
34
  split: test
35
  metrics:
36
+ - type: rouge
 
37
  value: 35.2055
38
+ name: ROUGE-1
39
  verified: true
40
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTA5OTZkY2YxMDU1YzE3NGJlMmE1OTg1NjlmNzcxOTg4YzY2OThlOTlkNGFhMGFjZWY4YjdiMjU5NDdmMWYzNSIsInZlcnNpb24iOjF9.ufBRoV2JoX4UlEfAUOYq7F3tZougwngdpKlnaC37tYXJU3omsR5hTsWM69hSdYO-k0cKUbAWCAMzjmoGwIaPAw
41
+ - type: rouge
42
  value: 16.5689
43
+ name: ROUGE-2
44
  verified: true
45
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWQwMmM2NjJjNzM1N2Y3NjZmMmE5NzNlNjRjNjEwNzNhNjcyZTRiMGRlODY3NWUyMGQ0YzZmMGFhODYzOTRmOSIsInZlcnNpb24iOjF9.AZZkbaYBZG6rw6-QHYjRlSl-p0gBT2EtJxwjIP7QYH5XIQjeoiQsTnDPIq25dSMDbmQLSZnpHC104ZctX0f_Dg
46
+ - type: rouge
47
  value: 30.1285
48
+ name: ROUGE-L
49
  verified: true
50
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTRjYThlMTllZjI4MGFiMDZhZTVkYmRjMTNhZDUzNTQ0OWQyNDQxMmQ5ODJiMmJiNGI3OTAzYjhiMzc2MTI4NCIsInZlcnNpb24iOjF9.zTHd3F4ZlgS-azl-ZVjOckcTrtrJmDOGWVaC3qQsvvn2UW9TnseNkmo7KBc3DJU7_NmlxWZArl1BdSetED0NCg
51
+ - type: rouge
52
  value: 30.1706
53
+ name: ROUGE-LSUM
54
  verified: true
55
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGMzZGFjNzVkYWI0NTJkMmZjZDQ0YjhiYjIxN2VkNmJjMTgwZTk1NjFlOGU2NjNjM2VjYTNlYTBhNTQ5MGZkNSIsInZlcnNpb24iOjF9.xQ2LoI3PwlEiXo1OT2o4Pq9o2thYCd9lSCKCWlLmZdxI5GxdsjcASBKmHKopzUcwCGBPR7zF95MHSAPyszOODA
56
+ - type: loss
57
  value: 2.7092134952545166
58
+ name: loss
59
  verified: true
60
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzQzODE0NDc5YTYzYjJlMWU2YTVjOGRjN2JmYWVkOWNkNTRlMTZlOWIyN2NiODJkMDljMjI3YzZmYzM3N2JjYSIsInZlcnNpb24iOjF9.Vv_pdeFuRMoKK3cPr5P6n7D6_18ChJX-2qcT0y4is3XX3mS98fk3U1AYEuy9nBHOwYR3o0U8WBgQ-Ya_FqefBg
61
+ - type: gen_len
62
  value: 15.1414
63
+ name: gen_len
64
  verified: true
65
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjk5OTk3NWRiNjZlZmQzMmYwOTU2MmQwOWE1MDNlNTg3YWVkOTgwOTc2ZTQ0MTBiZjliOWMyZTYwMDI2MDUzYiIsInZlcnNpb24iOjF9.Zvj84JzIhM50rWTQ2GrEeOU7HrS8KsILH-8ApTcSWSI6kVnucY0MyW2ODxvRAa_zHeCygFW6Q13TFGrT5kLNAA
66
  ---
67
 
68
  ### PEGASUS for Financial Summarization