lewtun HF staff commited on
Commit
e803f93
1 Parent(s): ee7a0dd

Add evaluation results on billsum dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [billsum](https://huggingface.co/datasets/billsum) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-e1d72cd6-7845033).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=billsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=billsum).

Files changed (1) hide show
  1. README.md +80 -77
README.md CHANGED
@@ -6,83 +6,53 @@ tags:
6
  - summarization
7
  - t5
8
  widget:
9
- - text: "The people of the State of California do enact as
10
- follows: SECTION 1. The Legislature hereby finds
11
- and declares as follows: (a) Many areas of the
12
- state are disproportionately impacted by drought
13
- because they are heavily dependent or completely
14
- reliant on groundwater from basins that are in
15
- overdraft and in which the water table declines
16
- year after year or from basins that are
17
- contaminated. (b) There are a number of state
18
- grant and loan programs that provide financial
19
- assistance to communities to address drinking
20
- water and wastewater needs. Unfortunately, there
21
- is no program in place to provide similar
22
- assistance to individual homeowners who are
23
- reliant on their own groundwater wells and who may
24
- not be able to afford conventional private loans
25
- to undertake vital water supply, water quality,
26
- and wastewater improvements. (c) The program
27
- created by this act is intended to bridge that gap
28
- by providing low-interest loans, grants, or both,
29
- to individual homeowners to undertake actions
30
- necessary to provide safer, cleaner, and more
31
- reliable drinking water and wastewater treatment.
32
- These actions may include, but are not limited to,
33
- digging deeper wells, improving existing wells and
34
- related equipment, addressing drinking water
35
- contaminants in the homeowner’s water, or
36
- connecting to a local water or wastewater system. SEC. 2. Chapter 6.6 (commencing with Section
37
- 13486) is added to Division 7 of the Water Code,
38
- to read: CHAPTER 6.6. Water and Wastewater Loan
39
- and Grant Program 13486. (a) The board shall
40
- establish a program in accordance with this
41
- chapter to provide low-interest loans and grants
42
- to local agencies for low-interest loans and
43
- grants to eligible applicants for any of the
44
- following purposes:"
45
- example_title: "Water use"
46
- - text: "The people of the State of California do enact as
47
- follows: SECTION 1. Section 2196 of the
48
- Elections Code is amended to read: 2196. (a) (1)
49
- Notwithstanding any other provision of law, a
50
- person who is qualified to register to vote and
51
- who has a valid California driver’s license or
52
- state identification card may submit an affidavit
53
- of voter registration electronically on the
54
- Internet Web site of the Secretary of State. (2)
55
- An affidavit submitted pursuant to this section is
56
- effective upon receipt of the affidavit by the
57
- Secretary of State if the affidavit is received on
58
- or before the last day to register for an election
59
- to be held in the precinct of the person
60
- submitting the affidavit. (3) The affiant shall
61
- affirmatively attest to the truth of the
62
- information provided in the affidavit. (4) For
63
- voter registration purposes, the applicant shall
64
- affirmatively assent to the use of his or her
65
- signature from his or her driver’s license or
66
- state identification card. (5) For each electronic
67
- affidavit, the Secretary of State shall obtain an
68
- electronic copy of the applicant’s signature from
69
- his or her driver’s license or state
70
- identification card directly from the Department
71
- of Motor Vehicles. (6) The Secretary of State
72
- shall require a person who submits an affidavit
73
- pursuant to this section to submit all of the
74
- following: (A) The number from his or her
75
- California driver’s license or state
76
- identification card. (B) His or her date of birth.
77
- (C) The last four digits of his or her social
78
- security number. (D) Any other information the
79
- Secretary of State deems necessary to establish
80
- the identity of the affiant. (7) Upon submission
81
- of an affidavit pursuant to this section, the
82
- electronic voter registration system shall provide
83
- for immediate verification of both of the
84
- following:"
85
- example_title: "Election"
86
  metrics:
87
  - rouge
88
  model-index:
@@ -99,6 +69,39 @@ model-index:
99
  - name: Rouge1
100
  type: rouge
101
  value: 12.6315
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
102
  ---
103
 
104
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
6
  - summarization
7
  - t5
8
  widget:
9
+ - text: "The people of the State of California do enact as follows: SECTION 1. The\
10
+ \ Legislature hereby finds and declares as follows: (a) Many areas of the state\
11
+ \ are disproportionately impacted by drought because they are heavily dependent\
12
+ \ or completely reliant on groundwater from basins that are in overdraft and in\
13
+ \ which the water table declines year after year or from basins that are contaminated.\
14
+ \ (b) There are a number of state grant and loan programs that provide financial\
15
+ \ assistance to communities to address drinking water and wastewater needs. Unfortunately,\
16
+ \ there is no program in place to provide similar assistance to individual homeowners\
17
+ \ who are reliant on their own groundwater wells and who may not be able to afford\
18
+ \ conventional private loans to undertake vital water supply, water quality, and\
19
+ \ wastewater improvements. (c) The program created by this act is intended to\
20
+ \ bridge that gap by providing low-interest loans, grants, or both, to individual\
21
+ \ homeowners to undertake actions necessary to provide safer, cleaner, and more\
22
+ \ reliable drinking water and wastewater treatment. These actions may include,\
23
+ \ but are not limited to, digging deeper wells, improving existing wells and related\
24
+ \ equipment, addressing drinking water contaminants in the homeowner\u2019s water,\
25
+ \ or connecting to a local water or wastewater system. SEC. 2. Chapter 6.6 (commencing\
26
+ \ with Section 13486) is added to Division 7 of the Water Code, to read: CHAPTER\
27
+ \ 6.6. Water and Wastewater Loan and Grant Program 13486. (a) The board shall\
28
+ \ establish a program in accordance with this chapter to provide low-interest\
29
+ \ loans and grants to local agencies for low-interest loans and grants to eligible\
30
+ \ applicants for any of the following purposes:"
31
+ example_title: Water use
32
+ - text: "The people of the State of California do enact as follows: SECTION 1. Section\
33
+ \ 2196 of the Elections Code is amended to read: 2196. (a) (1) Notwithstanding\
34
+ \ any other provision of law, a person who is qualified to register to vote and\
35
+ \ who has a valid California driver\u2019s license or state identification card\
36
+ \ may submit an affidavit of voter registration electronically on the Internet\
37
+ \ Web site of the Secretary of State. (2) An affidavit submitted pursuant to this\
38
+ \ section is effective upon receipt of the affidavit by the Secretary of State\
39
+ \ if the affidavit is received on or before the last day to register for an election\
40
+ \ to be held in the precinct of the person submitting the affidavit. (3) The affiant\
41
+ \ shall affirmatively attest to the truth of the information provided in the affidavit.\
42
+ \ (4) For voter registration purposes, the applicant shall affirmatively assent\
43
+ \ to the use of his or her signature from his or her driver\u2019s license or\
44
+ \ state identification card. (5) For each electronic affidavit, the Secretary\
45
+ \ of State shall obtain an electronic copy of the applicant\u2019s signature from\
46
+ \ his or her driver\u2019s license or state identification card directly from\
47
+ \ the Department of Motor Vehicles. (6) The Secretary of State shall require a\
48
+ \ person who submits an affidavit pursuant to this section to submit all of the\
49
+ \ following: (A) The number from his or her California driver\u2019s license or\
50
+ \ state identification card. (B) His or her date of birth. (C) The last four digits\
51
+ \ of his or her social security number. (D) Any other information the Secretary\
52
+ \ of State deems necessary to establish the identity of the affiant. (7) Upon\
53
+ \ submission of an affidavit pursuant to this section, the electronic voter registration\
54
+ \ system shall provide for immediate verification of both of the following:"
55
+ example_title: Election
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
  metrics:
57
  - rouge
58
  model-index:
 
69
  - name: Rouge1
70
  type: rouge
71
  value: 12.6315
72
+ - task:
73
+ type: summarization
74
+ name: Summarization
75
+ dataset:
76
+ name: billsum
77
+ type: billsum
78
+ config: default
79
+ split: test
80
+ metrics:
81
+ - name: ROUGE-1
82
+ type: rouge
83
+ value: 12.1368
84
+ verified: true
85
+ - name: ROUGE-2
86
+ type: rouge
87
+ value: 4.6017
88
+ verified: true
89
+ - name: ROUGE-L
90
+ type: rouge
91
+ value: 10.0767
92
+ verified: true
93
+ - name: ROUGE-LSUM
94
+ type: rouge
95
+ value: 10.6892
96
+ verified: true
97
+ - name: loss
98
+ type: loss
99
+ value: 2.897707462310791
100
+ verified: true
101
+ - name: gen_len
102
+ type: gen_len
103
+ value: 19.0
104
+ verified: true
105
  ---
106
 
107
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You