Commit
•
5a1b512
1
Parent(s):
4c7b827
Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (#2)
Browse files- Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (2876f6f6d18a49e19585f1a82e15088d35ed171d)
Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>
README.md
CHANGED
@@ -1,27 +1,26 @@
|
|
1 |
---
|
2 |
language:
|
3 |
- en
|
4 |
-
tags:
|
5 |
- summarization
|
6 |
datasets:
|
7 |
- xsum
|
8 |
metrics:
|
9 |
- rouge
|
10 |
widget:
|
11 |
-
- text:
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
|
19 |
-
|
20 |
-
|
21 |
-
|
22 |
-
|
23 |
-
|
24 |
-
|
25 |
model-index:
|
26 |
- name: human-centered-summarization/financial-summarization-pegasus
|
27 |
results:
|
@@ -34,30 +33,36 @@ model-index:
|
|
34 |
config: default
|
35 |
split: test
|
36 |
metrics:
|
37 |
-
-
|
38 |
-
type: rouge
|
39 |
value: 35.2055
|
|
|
40 |
verified: true
|
41 |
-
|
42 |
-
|
43 |
value: 16.5689
|
|
|
44 |
verified: true
|
45 |
-
|
46 |
-
|
47 |
value: 30.1285
|
|
|
48 |
verified: true
|
49 |
-
|
50 |
-
|
51 |
value: 30.1706
|
|
|
52 |
verified: true
|
53 |
-
|
54 |
-
|
55 |
value: 2.7092134952545166
|
|
|
56 |
verified: true
|
57 |
-
|
58 |
-
|
59 |
value: 15.1414
|
|
|
60 |
verified: true
|
|
|
61 |
---
|
62 |
|
63 |
### PEGASUS for Financial Summarization
|
|
|
1 |
---
|
2 |
language:
|
3 |
- en
|
4 |
+
tags:
|
5 |
- summarization
|
6 |
datasets:
|
7 |
- xsum
|
8 |
metrics:
|
9 |
- rouge
|
10 |
widget:
|
11 |
+
- text: National Commercial Bank (NCB), Saudi Arabia’s largest lender by assets, agreed
|
12 |
+
to buy rival Samba Financial Group for $15 billion in the biggest banking takeover
|
13 |
+
this year.NCB will pay 28.45 riyals ($7.58) for each Samba share, according to
|
14 |
+
a statement on Sunday, valuing it at about 55.7 billion riyals. NCB will offer
|
15 |
+
0.739 new shares for each Samba share, at the lower end of the 0.736-0.787 ratio
|
16 |
+
the banks set when they signed an initial framework agreement in June.The offer
|
17 |
+
is a 3.5% premium to Samba’s Oct. 8 closing price of 27.50 riyals and about 24%
|
18 |
+
higher than the level the shares traded at before the talks were made public.
|
19 |
+
Bloomberg News first reported the merger discussions.The new bank will have total
|
20 |
+
assets of more than $220 billion, creating the Gulf region’s third-largest lender.
|
21 |
+
The entity’s $46 billion market capitalization nearly matches that of Qatar National
|
22 |
+
Bank QPSC, which is still the Middle East’s biggest lender with about $268 billion
|
23 |
+
of assets.
|
|
|
24 |
model-index:
|
25 |
- name: human-centered-summarization/financial-summarization-pegasus
|
26 |
results:
|
|
|
33 |
config: default
|
34 |
split: test
|
35 |
metrics:
|
36 |
+
- type: rouge
|
|
|
37 |
value: 35.2055
|
38 |
+
name: ROUGE-1
|
39 |
verified: true
|
40 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTA5OTZkY2YxMDU1YzE3NGJlMmE1OTg1NjlmNzcxOTg4YzY2OThlOTlkNGFhMGFjZWY4YjdiMjU5NDdmMWYzNSIsInZlcnNpb24iOjF9.ufBRoV2JoX4UlEfAUOYq7F3tZougwngdpKlnaC37tYXJU3omsR5hTsWM69hSdYO-k0cKUbAWCAMzjmoGwIaPAw
|
41 |
+
- type: rouge
|
42 |
value: 16.5689
|
43 |
+
name: ROUGE-2
|
44 |
verified: true
|
45 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWQwMmM2NjJjNzM1N2Y3NjZmMmE5NzNlNjRjNjEwNzNhNjcyZTRiMGRlODY3NWUyMGQ0YzZmMGFhODYzOTRmOSIsInZlcnNpb24iOjF9.AZZkbaYBZG6rw6-QHYjRlSl-p0gBT2EtJxwjIP7QYH5XIQjeoiQsTnDPIq25dSMDbmQLSZnpHC104ZctX0f_Dg
|
46 |
+
- type: rouge
|
47 |
value: 30.1285
|
48 |
+
name: ROUGE-L
|
49 |
verified: true
|
50 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTRjYThlMTllZjI4MGFiMDZhZTVkYmRjMTNhZDUzNTQ0OWQyNDQxMmQ5ODJiMmJiNGI3OTAzYjhiMzc2MTI4NCIsInZlcnNpb24iOjF9.zTHd3F4ZlgS-azl-ZVjOckcTrtrJmDOGWVaC3qQsvvn2UW9TnseNkmo7KBc3DJU7_NmlxWZArl1BdSetED0NCg
|
51 |
+
- type: rouge
|
52 |
value: 30.1706
|
53 |
+
name: ROUGE-LSUM
|
54 |
verified: true
|
55 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGMzZGFjNzVkYWI0NTJkMmZjZDQ0YjhiYjIxN2VkNmJjMTgwZTk1NjFlOGU2NjNjM2VjYTNlYTBhNTQ5MGZkNSIsInZlcnNpb24iOjF9.xQ2LoI3PwlEiXo1OT2o4Pq9o2thYCd9lSCKCWlLmZdxI5GxdsjcASBKmHKopzUcwCGBPR7zF95MHSAPyszOODA
|
56 |
+
- type: loss
|
57 |
value: 2.7092134952545166
|
58 |
+
name: loss
|
59 |
verified: true
|
60 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzQzODE0NDc5YTYzYjJlMWU2YTVjOGRjN2JmYWVkOWNkNTRlMTZlOWIyN2NiODJkMDljMjI3YzZmYzM3N2JjYSIsInZlcnNpb24iOjF9.Vv_pdeFuRMoKK3cPr5P6n7D6_18ChJX-2qcT0y4is3XX3mS98fk3U1AYEuy9nBHOwYR3o0U8WBgQ-Ya_FqefBg
|
61 |
+
- type: gen_len
|
62 |
value: 15.1414
|
63 |
+
name: gen_len
|
64 |
verified: true
|
65 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjk5OTk3NWRiNjZlZmQzMmYwOTU2MmQwOWE1MDNlNTg3YWVkOTgwOTc2ZTQ0MTBiZjliOWMyZTYwMDI2MDUzYiIsInZlcnNpb24iOjF9.Zvj84JzIhM50rWTQ2GrEeOU7HrS8KsILH-8ApTcSWSI6kVnucY0MyW2ODxvRAa_zHeCygFW6Q13TFGrT5kLNAA
|
66 |
---
|
67 |
|
68 |
### PEGASUS for Financial Summarization
|