AndreaBozzo/ceres-open-data-index huggingface dataset:
Crossing Inventory Warning Device Equipment Summary (8.10)

This report contains data for the highway-rail crossing inventory, broken out by the highest level of warning device present at the crossing. There are four views of data: by (1) state, (2) county, (3) city, and (4) railroad. The data is grouped by the type of warning devices present: four quad (full barrier) gates, all other gates, flashing lights, highway signals/bells, special active warning devices, stop signs, crossbucks, other signs or signals, or no signs or signals.

Tags: railroad-safety
Organization: Department of Transportation
AuthHist

*This is a "daily difference" dataset.  See dataset attachment "FMCSA Dataset Description and Data Definitions - Select Datasets" for more information.*  Records showing the history of each authority granted to a carrier/broker/freight forwarder, along with the dates of the original authority action (e.g., “granted”) and the final authority action (e.g., “revoked”). The dataset contains the DOT number and docket number of the entity that holds or held the authority. As there can be multiple authorities for a single entity, there may be multiple records for an entity.

Tags: active, for-hire-motor-carriers, operating-authority, registration-status, revoked, suspended
Organization: Department of Transportation
Rejected

*This is a "daily difference" dataset.  See dataset attachment "FMCSA Dataset Description and Data Definitions - Select Datasets" for more information.*  Information on insurance forms that were rejected by FMCSA. The dataset contains information on the insurance policy associated with the form, along with the date that the form was rejected and the reason for rejection (e.g., “Policy is already cancelled”). The dataset contains the DOT number and docket number of the carrier/broker/freight forwarder associated with the policy.

Tags: active, for-hire-motor-carriers, operating-authority, registration-status, revoked, suspended
Organization: Department of Transportation
Rail Mileposts

The FRA Milepost is a spatial file that originates of multiple sources and contains point locations of mileposts along the FRA's rail network.  The mileposts was developed from varies sources and should only be used as a reference file.  The railroad lines and their mileposts are privately owned and are subjected of changed based on the rail owner.  If used for identifying specific locations, please contact the railroad to verify the mileposts numbers and their locations.

Tags: railroad-safety
Organization: Department of Transportation
Injury/Illness Summary - Operational Source Data (Form 55)

All railroads are required to submit their operational data for train miles, employee hours worked, yard switching miles, the number of passengers transported, and passenger miles monthly on Form FRA F 6180.55 Injury/Illness Summary [Operational Data]. 

This dataset is the source dataset and contains raw data values. It replaced the legacy data download (https://safetydata.fra.dot.gov/OfficeofSafety/publicsite/on_the_fly_download.aspx). To download data that contains data is a user-friendly human-readable format, please reference https://data.transportation.gov/Railroads/Injury-Illness-Summary-Operational-Data/m8i6-zdsy.

The data dictionary can be found here: https://data.transportation.gov/api/views/unww-uhxd/files/fa3f4232-2794-45ed-8062-afae43a860fd?download=true&filename=rrsfile_EFFECTIVE_060111%20(1).pdf. 

For information on how to filter and export data, please visit: https://data.transportation.gov/stories/s/Download-Export-and-Print-User-Guide/s8hj-vns8/.

To view the data release schedule, please visit: https://data.transportation.gov/stories/s/Data-Release-Schedule/qfc9-tapk/.

Tags: form-55, miles, operational-data, passenger-miles
Organization: Department of Transportation
Crossing Inventory Data (Form 71) - Historical

A highway-rail crossing is a location where a public highway, road, street, or private roadway, including associated sidewalks and pathways, crosses one or more railroad tracks. All such crossings are reported by railroads and state Department of Transportations to the FRA on Form FRA F 6180.71 U.S. DOT Crossing Inventory Form. Each location has an assigned U.S. DOT Grade Crossing Identification Number, or crossing ID.

This dataset is in a user-friendly human-readable format. It contains the historical crossing inventory. To download the current inventory data, go here: https://data.transportation.gov/Railroads/Crossing-Inventory-Data-Form-71-Current/m2f8-22s6.

The data dictionary can be found here: https://data.transportation.gov/api/views/m2f8-22s6/files/55a89796-f127-402c-82e3-09d5af892b42?download=true&filename=Form71_Data_Dictionary.xlsx.

For information on how to filter and export data, please visit: https://data.transportation.gov/stories/s/Download-Export-and-Print-User-Guide/s8hj-vns8/. 

To view the data release schedule, please visit: https://data.transportation.gov/stories/s/Data-Release-Schedule/qfc9-tapk/.

Tags: crossing, crossing-inventory, form-71, highway-rail, highway-rail-grade-crossing, inventory
Organization: Department of Transportation
Crossing Inventory Source Data (Form 71) - Current

A highway-rail crossing is a location where a public highway, road, street, or private roadway, including associated sidewalks and pathways, crosses one or more railroad tracks. All such crossings are reported by railroads and state Department of Transportations to the FRA on Form FRA F 6180.71 U.S. DOT Crossing Inventory Form. Each location has an assigned U.S. DOT Grade Crossing Identification Number, or crossing ID.

This dataset is the source dataset and contains raw data values. It replaced the legacy data download (https://safetydata.fra.dot.gov/OfficeofSafety/publicsite/DownloadCrossingInventoryData.aspx). To download data that contains data in a user-friendly human-readable format, please reference https://data.transportation.gov/Railroads/Crossing-Inventory-Data-Current/m2f8-22s6.

The data dictionary can be found here: https://data.transportation.gov/api/views/8uv2-y4is/files/9ad38db9-c214-4e51-8e0a-31eeaca0d77d?download=true&filename=GCIS_Data_Dictionary_External_Use_v3-2-0-152_Rel_06-21-2022.pdf

For information on how to filter and export data, please visit: https://data.transportation.gov/stories/s/Download-Export-and-Print-User-Guide/s8hj-vns8/. 

To view the data release schedule, please visit: https://data.transportation.gov/stories/s/Data-Release-Schedule/qfc9-tapk/.

Tags: crossing-inventory, crossing-inventory-form, form-71, highway-rail-crossing, highway-rail-grade-crossing
Organization: Department of Transportation
InsHist

*This is a "daily difference" dataset.  See dataset attachment "FMCSA Dataset Description and Data Definitions - Select Datasets" for more information.*  This dataset contains information on a carrier’s/broker’s/freight forwarder’s previous insurance policy(ies). This dataset contains the DOT number and docket number of the entity. Additionally, it contains the cancellation method (cancelled, replaced, name change, transferred), the type of policy, the policy number, and the effective and cancellation dates of the policy.

Tags: active, for-hire-motor-carriers, operating-authority, registration-status, revoked, suspended
Organization: Department of Transportation
Supply Chain and Freight Indicators

The U.S. Department of Transportation has convened an interagency working group, led by the Bureau of Transportation Statistics, to develop timely information on supply chain activity. The working group includes relevant DOT modes and the U.S. Departments of Agriculture, Energy, Commerce and Labor. 


BTS freight information covers the following four areas:
1. Port Data - Inside the Gate
2. Port Data - Outside the Gate
3. Freight Movement
4. Transportation Labor and Capacity Tightness

Visuals of the data can be found at: https://www.bts.gov/freight-indicators#container-capacity

Note: In May 2025, Canadian Pacific Kansas City (CPKC) started reporting data to reflect the April 14, 2023, merger of Canadian Pacific (CP) and Kansas City Southern (KCS). New charts representing CKPC data were added and new data for CKPC will be updated weekly from May 10, 2025. The charts for CP and KCS will not be updated in the future.

Tags: freight, port, rail, supply-chain, transportation, trucking
Organization: Department of Transportation
Campaign Finance - Filings Received by SFEC

<strong>A. SUMMARY</strong>
This dataset lists the current campaign filings received by the SFEC; Campaign forms include FPPC forms 410, 450, 460, 461, 465, 470, 496, 497. Refer to the <a href="https://fppc.ca.gov/forms.html">FPPC page for forms represented in this dataset</a>.
Filings of the following SFEC forms are also recorded in this dataset:
<ul>
<li>SFEC161 - Itemized Disclosure Statement for Mass Mailings</li>
<li>SFEC162 - Electioneering Communication Report</li>
<li>SFEC163 - Member Communication Report</li>
</ul>

<strong>B. HOW THE DATASET IS CREATED</strong>
Committees file campaign statements with the Ethics Commission on a periodic basis. Those statements are stored with the Commission's provider. Data is generally presented as-filed by committees.

<strong>C. UPDATE PROCESS</strong>
Each night starting at midnight Pacific time a script runs to check for new filings with the Commission's database, and updates this dataset with transactions from new filings. The update process can take a variable amount of time to complete. Viewing or downloading this dataset while the update is running may result in incomplete data, therefore it is highly recommended to view or download this data before midnight or after 8am.

<strong>D. HOW TO USE THIS DATASET</strong>
Filings received on paper will not have corresponding data in the Transactions or Summary datasets.
A "rejected" filing is usually one made in error, under the wrong filing account, or containing an error in reporting period.
Amendment filings supersede all transactions from the original filing and any prior amendments. Transactions from prior filings are removed from the accompanying "Transactions" dataset in order to represent the most up-to-date version of transactions.
"Filer Name" reflects the name of the committee at time of filing. Committees can change names over time.

Refer to the <a href="https://sfethics.org/disclosures/campaign-finance-disclosure/campaign-finance-disclosure-data">Ethics Commission's webpage</a> for more information.

<strong>RELATED DATASETS</strong>
<ul>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-San-Francisco-Campaign-Filers/4c8t-ngau">San Francisco Campaign Filers</a></li>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-Filings-Received-by-SFEC/qizs-bwft">Filings Received by SFEC</a></li>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-Summary-Totals/9ggq-m8hp">Summary Totals</a></li>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-Transactions/pitq-e56w">Transactions</a></li>
</ul>

Tags: campaign-finance, ethics
Organization: City of San Francisco
Meter Policies

<strong>A. SUMMARY</strong>
Dataset has  meter daily schedules with hourly rates.

<strong>B. HOW THE DATASET IS CREATED</strong>
Data is an extract from SFMTA Meter API process.

<strong>C. UPDATE PROCESS</strong>
Dataset is updated daily to reflect any changes in meter operational and rate schedules.

<strong>D. HOW TO USE THIS DATASET</strong>


<strong>E. RELATED DATASETS</strong>
 <u><a href="https://data.sfgov.org/Transportation/Meter-Inventory/uan2-8hmm">Meter Inventory</a></u>
 <u><a href="https://data.sfgov.org/Transportation/SFMTA-Parking-Meter-Detailed-Revenue-Transactions/imvp-dq3v/about_data">Meter Revenue</a></u>

Organization: City of San Francisco
Planning Department Records - Projects

A. SUMMARY
This dataset is a list of projects and project data captured by PRJ records from the Planning Department's Accela database.   Supplemental applications required by the Planning Department to review development projects are captured as related child records (CHILD_ID column) with the PRJ record serving as the parent record.  The dataset for related child records and other Planning records can be found at <a href="https://data.sfgov.org/Economy-and-Community/Planning-Department-Non-Projects/y673-d69b/about_data">https://data.sfgov.org/Economy-and-Community/Planning-Department-Non-Projects/y673-d69b/about_data</a>.

B. HOW THE DATASET IS CREATED
Records have been exported from the Planning Department's Accela permitting system.

C. UPDATE PROCESS
Updated nightly

D. HOW TO USE THIS DATASET
For further information on permits:
<a href="https://sfplanning.org/permits">https://sfplanning.org/permits</a>

Tags: planning, projects
Organization: City of San Francisco
Our415 - Our415 Organization Taxonomy Terms

<strong>A. SUMMARY</strong>
San Francisco offers numerous events and activities tailored for children, youth, and families. However, finding and navigating the disparate sources of information can be a major challenge. Our415.org seeks to simplify this by consolidating all relevant details, ensuring that families can easily find what they need, when they need it. It also encourages discovery of new interests and things to do. This dataset includes the categories and eligibilities associated with services, organizations and other resources on Our415.

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset was generated through categorization of services, organizations, and resources using the Our415 taxonomy.

<strong>C. UPDATE PROCESS</strong>
The dataset will be updated on a daily basis, reflecting changes to the source data.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be joined to the Services dataset (CHF-0013) or Organizations dataset (CHF-0014) using the ID field from the Services dataset and link_id field in the Taxonomy Terms dataset or ID field from the Organizations dataset and the link_id field in the Taxonomy Terms dataset. The link_entity field will determine if the link_id is associated with Services or Organizations.

<strong>E. RELATED DATASETS</strong>

<strong>F. KNOWN USES (please add)</strong>
Our415.org

Tags: our415
Organization: City of San Francisco
San Francisco Addresses with Units - Enterprise Addressing System

<strong>SUMMARY</strong>
All active addresses from the City's Enterprise Addressing System (EAS), including sub-addresses, such as units. Includes references to parcel and street centerline data (Note: not all addresses are associated with parcels).  Updated nightly.  For base addresses (not including units) see <a href="https://data.sfgov.org/d/3mea-di5p">the Addresses - Enterprise Address System dataset</a>.

<strong>HOW THE DATASET IS CREATED</strong>
This dataset is an extract from the Enterprise Addressing System, maintained by San Francisco's Department of Technology.

<strong>UPDATE PROCESS</strong>
This dataset updates nightly.

<strong>RELATED DATASETS</strong>
<li><a href="https://data.sfgov.org/d/3mea-di5p">the Addresses - Enterprise Address System dataset</a>

Tags: addresses, city-reference-data, dbi, eas, ref-basemap, unit
Organization: City of San Francisco
Our415 - Contact Information

<strong>A. SUMMARY</strong>
San Francisco offers numerous events and activities tailored for children, youth, and families. However, finding and navigating the disparate sources of information can be a major challenge. Our415.org seeks to simplify this by consolidating all relevant details, ensuring that families can easily find what they need, when they need it. It also encourages discovery of new interests and things to do. This dataset includes the contact numbers of organizations providing services in San Francisco for children, youth, and their families.

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset includes data collected from various sources including DCYF’s Contract Management System, Jotform, the SF Service Guide, and data shares from various departments in the City. 

<strong>C. UPDATE PROCESS</strong>
The dataset will be updated on a daily basis, reflecting changes to the source data. 

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be joined to the Organizations dataset (CHF-0012) using the ID field from the Organizations dataset and Organization_ID field in the Contact Information dataset. 

<strong>E. RELATED DATASETS</strong>
<u><a href=" https://data.sfgov.org/Economy-and-Community/Organizations-serving-Children-Youth-and-their-Fam/ddhd-yzyc/about_data ">Organizations</a></u>

Organization: City of San Francisco
Buyout Agreements

Contains buyout declarations and buyout agreements filed at the Rent Board. Rent Ordinance Section 37.9E, effective March 7, 2015, is a provision that regulates "buyout agreements" between landlords and tenants under which landlords pay tenants money or other consideration to vacate their rent-controlled rental units. For more information, please see: https://www.sf.gov/information/buyout-agreements

Tags: buyouts, rent-control
Organization: City of San Francisco
Historic Districts

<DIV STYLE="text-align:Left;"><DIV><DIV><P><SPAN>This dataset contains Historic Districts officially designated by the District of Columbia. Additional data sets are also available providing information on (1) historic landmarks in the District of Columbia.</SPAN></P></DIV></DIV></DIV>

Tags: district-of-columbia, historic-buildings, historic-districts, historic-preservation, landmark, national-historic-parks, national-historic-sites, national-register-of-historic-places, planning, property, washington-dc
Organization: District of Columbia
Our415 - Addresses & Locations of Organizations serving Children, Youth, and their Families

<strong>A. SUMMARY</strong>
San Francisco offers numerous events and activities tailored for children, youth, and families. However, finding and navigating the disparate sources of information can be a major challenge. Our415.org seeks to simplify this by consolidating all relevant details, ensuring that families can easily find what they need, when they need it. It also encourages discovery of new interests and things to do. This dataset includes data on the location of organizations providing services in San Francisco for children, youth, and their families.

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset includes data collected from various sources including DCYF’s Contract Management System, Jotform, the SF Service Guide, and data shares from various departments in the City. 

<strong>C. UPDATE PROCESS</strong>
The dataset will be updated on a daily basis, reflecting changes to the source data.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be joined to the Organizations dataset (CHF-0012) using the ID field from the Organizations dataset and Organization_ID field in the Locations dataset.

<strong>E. RELATED DATASETS</strong>
<u><a href=" https://data.sfgov.org/Economy-and-Community/Organizations-serving-Children-Youth-and-their-Fam/ddhd-yzyc/about_data ">Organizations</a></u>

<strong>F. KNOWN USES (please add)</strong>
Our415.org

Tags: our415
Organization: City of San Francisco
Lobbyist Activity Directory

<strong>A. SUMMARY</strong>
This dataset shows activity reported by registered lobbyists on their monthly statements. Learn more about the lobbyist program at the <a href="https://sfethics.org/guidance/lobbyists">SF Ethics Commission</a> website. 
Activities from both Contact and Expenditure lobbyists are combined in this dataset.

<strong>B. HOW THE DATASET IS CREATED</strong>
Lobbyists are required to register with the Ethics Commission and file monthly statements reporting their activity.

<strong>C. UPDATE PROCESS</strong>
Data from the lobbyist system is synched nightly to DataSF. If any filings have been accepted since the last update, the sync reflects new activity on those filings.

<strong>D. HOW TO USE THIS DATASET</strong>
Activities are self reported by lobbyists on monthly statements. All types of activities are reflected on this dataset, please refer to the <a href="https://sfethics.org/compliance/lobbyists">SF Ethics Commission website</a> to learn more about the lobbyist program. 
Refer to the "related content using this data" section below for links to filtered views by activity type, which limit the visible columns and may be more useful for analysis.

Tags: ethics, lobbyist
Organization: City of San Francisco
Public Dataset Access and Usage

<strong>A. SUMMARY</strong>
This dataset is used to report on public dataset access and usage within the open data portal. Each row sums the amount of users who access a dataset each day, grouped by access type (API Read, Download, Page View, etc).

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset is created by joining two internal analytics datasets generated by the SF Open Data Portal. We remove non-public information during the process. 

<strong>C. UPDATE PROCESS</strong>
This dataset is scheduled to update every 7 days via ETL.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can help you identify stale datasets, highlight the most popular datasets and calculate other metrics around the performance and usage in the open data portal.

Please note a special call-out for two fields:
- "derived": This field shows if an asset is an original source (derived = "False") or if it is made from another asset though filtering (derived = "True"). Essentially, if it is derived from another source or not. 
- "provenance": This field shows if an asset is "official" (created by someone in the city of San Francisco) or "community" (created by a member of the community, not official). All community assets are derived as members of the community cannot add data to the open data portal.

Organization: City of San Francisco
Health Inspection Scores (2024-Present)

<strong>SUMMARY</strong>
This dataset contains the results of health inspections conducted by the Department of Public Health from 2024 to Present. It includes the name and location of each facility inspected, the facility status (Pass, Conditional Pass, or Closure) after the inspection, and violations observed. 

<strong>HOW THIS DATASET IS CREATED</strong> 
After inspecting a facility, a Health Inspector assigns a facility status based on observed violations and health risk.

<strong>UPDATE PROCESS</strong>
This dataset will be updated monthly.

<strong>RELATED DATASETS</strong>
<li><u><a href="https://data.sfgov.org/d/tvy3-wexg">Health Inspections (2024-Present)</a></u>
<li><u><a href="https://data.sfgov.org/d/5tti-66ds">Health Inspections (2020-2023)</a></u>
<li><u><a href="https://data.sfgov.org/d/pyih-qa8i">Health Inspections (2016-2019)</a></u>
<li><u><a href="https://inspections.myhealthdepartment.com/san-francisco">Inspection lookup tool</a></u>

Organization: City of San Francisco