AndreaBozzo/ceres-open-data-index huggingface dataset:
Distributed Energy Resources Integrated Data System: Beginning 2001

The New York State Energy Research and Development Authority (NYSERDA) hosts a web-based Distributed Energy Resources (DER) integrated data system at https://der.nyserda.ny.gov/.  This site provides information on DERs that are funded by and report performance data to NYSERDA. Information is incorporated on more diverse DER technology as it becomes available. Distributed energy resources (DER) are technologies that generate or manage the demand of electricity at different points of the grid, such as at homes and businesses, instead of exclusively at power plants, and includes Combined Heat and Power (CHP) Systems, Anaerobic Digester Gas (ADG)-to-Electricity Systems, Fuel Cell Systems, Energy Storage Systems, and Large Photovoltaic (PV) Solar Electric Systems (larger than 50 kW). Historical databases with hourly readings for each system are updated each night to include data from the previous day.  The web interface allows users to view, plot, analyze, and download performance data from one or several different DER sites. Energy storage systems include all operational systems in New York including projects not funded by NYSERDA.  Only NYSERDA-funded energy storage systems will have performance data available. The database is intended to provide detailed, accurate performance data that can be used by potential users, developers, and other stakeholders to understand the real-world performance of these technologies. For NYSERDA’s performance-based programs, these data provide the basis for incentive payments to these sites.

The New York State Energy Research and Development Authority (NYSERDA) offers objective information and analysis, innovative programs, technical expertise, and support to help New Yorkers increase energy efficiency, save money, use renewable energy, and reduce reliance on fossil fuels. To learn more about NYSERDA’s programs, visit https://nyserda.ny.gov or follow us on X, Facebook, YouTube, or Instagram.
New York State Corporate Tax Credits by Size of Entire Net Income: Beginning Tax Year 2001

The Department of Taxation and Finance annually produces a mandated dataset of credit activity under the General Business Corporation Franchise Tax (Article 9‐A) to help analyze the effects of the claims. 
The data used to generate this report come from an annual study file based on the latest available data drawn from New York State corporation tax returns.  The totals in the summary datasets may not match the detail datasets due to rounding and disclosure requirements.  The totals in the summary datasets may not match the detail data due to rounding and disclosure requirements.  Total values for numbers of taxpayers and amount of credit, in addition to mean and median credit, were computed using all taxpayers in the study file.

A series of datasets presents profiles of the credits distributed by different subgroupings. These include:
•	Summarization of tax credit activity by credit and component
•	Summarization of tax credit activity by credit, component and basis of taxation.
•	Summarization of tax credit activity by credit, component and NAICS industry description.  
•	Summarization of tax credit activity by credit, component and the size of the credit used.  
•	Summarization of tax credit activity by credit, component and the size of the entire net income of the taxpayer.  

Secrecy provisions preclude providing all subgroupings for all credits and also generally require the omission of credit refund data.  These datasets only contains data for corporate franchise taxpayers filing under Article 9-A. It does not include statistics for taxpayers filing as banks under Article 32 (however, starting in 2015 banks and general business corporations will file under the same tax article, Article 9A), insurance companies filing under Article 33, or taxpayers filing under any of the various sections of Article 9. Nor does it provide data for taxpayers claiming credits under Article 22, the Personal Income Tax.  These taxpayers claim credit by virtue of being sole proprietors or as recipients of credit that originated with flow-through entities (i.e., S corporations, limited liability companies, or partnerships).
Alternative Fuel Stations in New York

Go to https://afdc.energy.gov/stations/#/find/nearest to access the full database of alternative fuel station locations nationwide, collected and maintained by the U.S. Department of Energy National Renewable Energy Laboratory.  A station appears as one point in the data and on the map, regardless of the number of fuel dispensers or charging outlets at that location.  For EV charging stations for example, the data includes the number of number of charging ports available at the specific station.

The New York State Energy Research and Development Authority (NYSERDA) offers objective information and analysis, innovative programs, technical expertise, and support to help New Yorkers increase energy efficiency, save money, use renewable energy, and reduce reliance on fossil fuels. To learn more about NYSERDA’s programs, visit https://nyserda.ny.gov or follow us on X, Facebook, YouTube, or Instagram.
New York State RGGI Funds

The Regional Greenhouse Gas Initiative (RGGI) is a multi-state cap-and-trade mechanism where polluters of greenhouse gas emissions must either reduce emissions or purchase emissions allowances. New York State allocates funds received from selling allowances to the New York State Energy Research and Development Authority (NYSERDA) to manage programs aimed at reducing fossil fuel consumption. The New York State RGGI Funds dataset provides the amount and category of funds received by the State from selling emissions allowances.

The New York State Energy Research and Development Authority (NYSERDA) offers objective information and analysis, innovative programs, technical expertise, and support to help New Yorkers increase energy efficiency, save money, use renewable energy, and reduce reliance on fossil fuels. To learn more about NYSERDA’s programs, visit https://nyserda.ny.gov or follow us on X, Facebook, YouTube, or Instagram.
Shared Ride Passengers at Port Authority of NY NJ Airports: Beginning 2005

The Port Authority of New York and New Jersey quarterly produces a data file and provides information on Shared Ride reservations. Shared Ride activity is defined as multiple stop “door to door” services  by authorized providers.    Although both reservation and passenger number for Shared Ride are simultaneously registered at the Port Authority’s Welcome Center when an individual makes a reservation, the Port Authority’s Ground Transportation Information System (GTIS) counts reservation numbers and passenger numbers separately as one reservation can have multiple passengers. This Shared Ride Reservation dataset reflects only the Shared Ride passengers.
Current Season Spring Trout Stocking Data Lens

DEC stocks close to 2 million catchable-size brook, brown, and rainbow trout in over 309 lakes and ponds and roughly 2,900 miles of streams across the state each spring. This dataset represents the planned stocking numbers, species and time of spring for those waters for the current fishing season. These are planned stockings for the year reported. Actual stocking may differ depending on fish availability, weather conditions and other factors during the year of stocking.  The current stocking data is updated annually in mid-March.
Citizen Statewide Lake Monitoring Assessment Program (CSLAP) Lakes

The dataset represents the lakes participating in the Citizen Statewide Lake Monitoring Assessment Program (CSLAP). CSLAP is a volunteer lake monitoring and education program that is managed by DEC and New York State Federation of Lake Associations (NYSFOLA). The data collected through the program is used to identify water quality issues, detect seasonal and long term patterns, and inform volunteers and lake residents about water quality conditions in their lake. The program has delivered high quality data to many DEC programs for over 25 years.The dataset catalogs CSLAP lake information; including: lake name, lake depth, public accessibility, trophic status, watershed area, elevation, lake area, water quality classification, county, town, CSLAP status, years sampled, and last year sampled.
Child and Dependent Care Credit By Place of Residence: Beginning Tax Year 2002

The Department of Taxation and Finance annually publishes statistical information on the New York State child and dependent care credit (NYS CDCC).  Summary data are presented for all taxpayers, including full-year New York state residents, part-year residents and nonresidents (where applicable).  Data are presented on a statewide and county-level basis for numbers and amounts of credit claims based on filing status and number of qualifying dependents.  Taxpayers filing “married separate” generally are not allowed to take the child and dependent care credit. 

The tables also include summary information for the New York City child and dependent care credit (NYC CDCC).  The data are presented on a county-level basis for numbers and amounts of credit claims at the aggregate level only.
Transportation Fuels Production and Demand: Beginning January 2017

Transportation Fuels Production and Demand dataset provides the weekly volumes of gasoline demand for the U.S. and production of finished gasoline for both the East Coast and the U.S. in terms of thousand barrels per day. Weekly data on kerosene-type jet fuel  production for both the East Coast and the U.S. is provided in terms of thousand barrels per day. Data is reported weekly beginning January 2017 through current.

The New York State Energy Research and Development Authority (NYSERDA) offers objective information and analysis, innovative programs, technical expertise, and support to help New Yorkers increase energy efficiency, save money, use renewable energy, and reduce reliance on fossil fuels. To learn more about NYSERDA’s programs, visit https://nyserda.ny.gov or follow us on X, Facebook, YouTube, or Instagram.
Child Welfare and Community Services Funded Programs

Included in this data set are data elements that will help the public identify all the programs currently funded by the New York State Office of Children and Family Services' (OCFS) Division of Child Welfare and Community Services (CWCS).  Data elements include the name of the provider agency, the business address and phone number, the county served, type of program, funding source, description of services, contract dates, contract number, funding level and the agencies website, where available
511 NY Events: Beginning 2010

The 511NY dataset contain historical traffic and transit event information provided by the New York State Department of Transportation (NYSDOT), the New York City Department of Transportation, the New York State Thruway Authority and the Niagara International Transportation Technology Coalition (Buffalo-Niagara Region). The file includes all incidents/accidents, construction projects and special events in New York State that were available on the 511NY traffic and transit map for the time period noted.
DMV Peer To Peer Car Sharing

This is a listing of NYS-registered vehicles offered by Peer-To-Peer car sharing companies.

Peer-To-Peer car sharing allows an owner of a vehicle to share their vehicle with another individual, known as a shared vehicle driver, for an agreed upon period. A shared vehicle made available for sharing under a peer-to-peer car sharing program must be covered by a group insurance policy provided through the peer-to-peer car sharing program administrator.
RSBS HVAC: New York State Residential Statewide Baseline Study: Heating, Ventilation, and Air Conditioning (HVAC) Contractor Survey

The New York State Energy Research and Development Authority (NYSERDA), in collaboration with the New York State Department of Public Service (DPS), conducted a statewide residential baseline study (study) from 2011 to 2014 of the single-family and multifamily residential housing segments, including new construction, and a broad range of energy uses and efficiency measures. This dataset includes data from 47 completed Heating Ventilation and Air Conditioning (HVAC) contractor surveys. The survey sample was stratified by the size of the HVAC contractor company: 28 survey completes for small companies (defined as having 1-10 employees) and 19 survey completes for large companies (defined as larger than 10 employees.) The surveys focused on employer or company information, sales of energy efficient HVAC equipment, installation practices, training, and experience with NYS energy efficiency programs.

The New York State Energy Research and Development Authority (NYSERDA) offers objective information and analysis, innovative programs, technical expertise, and support to help New Yorkers increase energy efficiency, save money, use renewable energy, and reduce reliance on fossil fuels. To learn more about NYSERDA’s programs, visit https://nyserda.ny.gov or follow us on X, Facebook, YouTube, or Instagram.
Advantage After School Program

Included in the data set are data elements that will help the public learn about the agencies currently contracting with New York State to provide Advantage After School Program services. The data elements are as follows:Contract Start Date, Contract End Date, Round Number, Contract Number, Contract Amount, School Levels Served (Elementary, Middle School, High School), Average Daily Attendance (MADA), Agency, Site Name, Street Address, Primary City, Zip Code.Also, the asterisks (*) indicate that the contract agency operates the program at two sites.
New York State Parks Concession Contracts

he New York State Office of Parks, Recreation and Historic Preservation (OPRHP) oversees more than 250 state parks, historic sites, recreational trails, golf courses, boat launches and more,  encompassing nearly 350,000 acres, that are visited by 74 million people annually.  These facilities contribute to the economic vitality and quality of life of local communities and directly support New York’s tourism industry.  Parks also provide a place for families and children to be active and exercise, promoting healthy lifestyles.  The agency is responsible for the operation and stewardship of the state park system as well as advancing a statewide parks, historic preservation, and open space mission.  

This dataset includes the name, concesson type and term of concession contracts active in New York State Parks during the most recent calendar year.
Peconic Bay Small Mesh Trawl Survey Annual Catch per Unit Effort: Beginning 1987

In the early 1980s, the New York State Department of Environmental Conservation (NYSDEC) began the development of a fishery-independent trawl survey program to monitor and assess local populations of weakfish (Cynoscion regalis) in the Peconic Estuary. The project was initiated based on the research recommendations of the Atlantic States Marine Fisheries Commission’s (ASMFC) Fishery Management Plan for Weakfish (Mercer, 1985). Gear and methodology for this survey were finally standardized in 1987 after 3 years of trials, and the official dataset for this survey begins in 1987. 
The initial intent of the survey was to develop an annual index of recruitment of juvenile weakfish and determine the relationship between spawning stock and environmental factors on year-class strength for weakfish. Although this survey was designed to study juvenile weakfish, due to the diverse number of species in the Peconic Estuary, data collection was expanded to include identifying and measuring all species of fish, as well as squid, horseshoe crabs, and mantis shrimp. Species of macroinvertebrates are identified and counted (Weber, Grahn, and Havens, 1998). As of 2019, certain macroinvertebrates (calico crabs and whelk species) are being measured as well to provide more data in efforts towards conservation and management of those species. 
While many of the species encountered in the trawl may not themselves be directly important to New York’s recreational and commercial fisheries, some of these species are significant as forage or bait species (e.g. Anchovies, Herring, Silversides), as well as providing insight into the ecological relationships among these species and their significance as indicators of the health and well-being of this important estuary.
The catch per unit effort (CPUE) measures the quantity of fish caught during one tow of the trawl. This is used to estimate the abundance of fish in a population. This dataset includes the average CPUE by species and year.
Aquatic Biological Monitoring Sampling Locations: Beginning 1980

The Division of Water Stream Biomonitoring Unit (SBU) dataset contains the point sampling locations at which benthic macroinvertebrates, field chemistry, and at some locations, sediment, fish or diatoms have been collected as part of the Rotating Integrated Basin Studies (RIBS) program, Rapid Biological Assessments (RAS), or special studies. The data collected are used for water quality assessment (input to the Waterbody Inventory, completion of the 305(b) report and 303(d) list of impaired Waters) and for track-down of water quality problems. The data set is maintained by the Division of Water, Bureau of Water Assessment and Management, Stream Biomonitoring Unit.
MTA Open Data User Personas

User personas are a human-centered design tool that help open data program administrators design programs offerings for the full community open data users for maximum reach and impact. User personas help keep real people in mind when designing program offerings and can identify user segments in the open data community that have the potential to use open data to help solve problems.

The Metropolitan Transportation Authority (MTA) is excited to share our open data user personas which were designed in collaboration with our existing open data community through multiple stakeholder workshops.
Average Residential Retail Kerosene Prices by Region: Beginning 2000

The Average Residential Retail Kerosene Prices dataset provides New York residents and businesses with objective information on average residential retail kerosene pricing in New York State and by region beginning September 4, 2000. Pricing data is obtained via surveys conducted by New York State Energy Research and Development Authority (NYSERDA) staff on a weekly basis during heating season (September to March) and bi-weekly during the rest of the year. All prices are listed in dollars per gallon.

The Average Home Heating Oil Prices dataset, Average Residential Retail Kerosene Prices dataset, and Average Residential Retail Propane Prices dataset are collectively referred to as the Heating Fuel Prices dataset.

For current and historical residential retail price data, regional comparisons, and fuel type comparisons, please visit the Kerosene Prices Dashboard: https://www.nyserda.ny.gov/researchers-and-policymakers/energy-prices/kerosene/average-kerosene-prices 

The New York State Energy Research and Development Authority (NYSERDA) offers objective information and analysis, innovative programs, technical expertise, and support to help New Yorkers increase energy efficiency, save money, use renewable energy, and reduce reliance on fossil fuels. To learn more about NYSERDA’s programs, visit https://nyserda.ny.gov or follow us on X, Facebook, YouTube, or Instagram.
Charge Ready NY Programs: Beginning 2018

The Charge Ready NY Program (Program) is an incentive program designed to accelerate the deployment of Level 2 electric vehicle charging equipment at public, workplaces, and multi-unit dwellings (MUDs) in New York State. Accelerated deployment of charging equipment will increase the adoption of electric vehicles by making charging more convenient. Increased use of electric vehicles and electric vehicle charging stations benefits New York State by reducing harmful emissions and the transportation sector’s dependence on petroleum. The New York State Energy Research and Development Authority (NYSERDA) developed the Program to provide incentives that reduce the cost of purchasing and installing eligible Level 2 charging equipment for use in New York State.

This dataset contains information on installed projects from both the current program, Charge Ready NY 2.0, and a former program, Charge Ready NY. 

The New York State Energy Research and Development Authority (NYSERDA) offers objective information and analysis, innovative programs, technical expertise, and support to help New Yorkers increase energy efficiency, save money, use renewable energy, and reduce reliance on fossil fuels. To learn more about NYSERDA’s programs, visit nyserda.ny.gov or follow us on X, Facebook, YouTube, or Instagram.
Youth Admission and Discharge Demographics:  Beginning 2003

This dataset provides county-level demographic data (sex, adjudication, age, race/ethnicity, and service setting) for youth admitted to and discharged from the care and custody of the Office of Children and Family Services (OCFS) each year. Data are counted using a youth’s first admission or discharge in a calendar year. Admissions data are aggregate based on the responsible (court) county. Discharges data are aggregate based on the county of residence.
State Park Facility Points

The New York State Office of Parks, Recreation and Historic Preservation (OPRHP) oversees more than 250 state parks, historic sites, recreational trails, golf courses, boat launches and more,  encompassing nearly 350,000 acres, that are visited by 74 million people annually.  These facilities contribute to the economic vitality and quality of life of local communities and directly support New York’s tourism industry.  Parks also provide a place for families and children to be active and exercise, promoting healthy lifestyles.  The agency is responsible for the operation and stewardship of the state park system as well as advancing a statewide parks, historic preservation, and open space mission.
Industrial Development Agencies' Project Data

Industrial Development Agencies (IDA) are required by section 859 of General Municipal Law to submit annual financial statements and are required by Section 2800 of Public Authorities Law to submit annual reports to the Authorities Budget Office. The reported information includes financial assistance provided by the IDA and job creation/retention for each project receiving assistance. The dataset includes project data as reported by each IDA that covers 8 fiscal years, which includes fiscal years ending in the most recently completed calendar year.
Northern-Southern Hunting Zone Line

This data depicts the east-west line that separates northern and southern hunting zones in New
York State.
A line separating the Northern and Southern Zone portions of New York State described as
follows: a line commencing at a point at the north shore of the Salmon river and its junction
with Lake Ontario and extending easterly along the north shore of that river to the village of
Pulaski, thence southerly along Route 11 to its intersection with Route 49 in the village of
Central Square, thence easterly along Route 49 to its junction with Route 365 in the city of
Rome, thence easterly along Route 365 to its junction with Route 28 in the village of Trenton,
thence easterly along Route 28 to its junction with Route 29 in the village of Middleville, thence
easterly along Route 29 to its junction with Route 4, thence northerly along Route 4 to its
junction with Route 22, thence northerly and westerly along Route 22 to the eastern shore of
South Bay on Lake Champlain in the village of Whitehall, thence northerly along the eastern
shore of South Bay to the New York-Vermont boundary.