AndreaBozzo/ceres-open-data-index huggingface dataset:
Street-Use Permits

<strong>Note 1/17/2025:</strong> This dataset has been backfilled to include additional permit status and historical permit data. Please see <u><a href="https://data.sfgov.org/d/x8nh-xzn6">Active Street-Use Permits</a></u> if you are only interested in currently active permits. 

<strong>A. SUMMARY</strong>
All street space permits received by SF Public Works. This includes permits in all statuses of review by Public Works, including those approved and issued as well as those pending review, closed or withdrawn. The dataset includes permits received since 1996. A street space permit grants permission to temporarily occupy a portion of a public roadway or sidewalk for building construction and other construction related work. Find out more about street space permits <u><a href="https://sfpublicworks.org/services/permits/street-space">here</a></u>. 

<strong>B. HOW THE DATASET IS CREATED</strong>
The dataset is extracted by SF Public Works from its source system and transmitted directly to the Open Data Portal via an automated pipeline.

<strong>C. UPDATE PROCESS</strong>
The dataset is updated daily at 12am with a one day lag.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be used to identify the status of any street space permits received by SF Public Works since 1996. Some of the data fields are from early versions of Public Works current system and may not have been validated when first entered. Some fields such as the DBI Building Permit Application (“bpa” field) are entered by Public Works staff and are not validated against Building Permit Applications in DBI’s Permit Tracking System (PTS).

A single permit may be repeated on multiple rows if it covers more than one street or location. You can use the permit_number field to identify the unique number of permits.

The <strong>data_as_of</strong> field represents when the row was updated, and can be used for incremental loading of the data in conjunction with the unique_id.

<strong>E. RELATED DATASETS</strong>
<li> <u><a href="https://data.sfgov.org/d/x8nh-xzn6/about_data">Active street permits</a></u>

Tags: banner, chairs, display, excavation, food, mobile, mounted, occupancy, permits, row, surface, tables, temporary, truck
Organization: City of San Francisco
Police Accountability Misconduct Cases and Allegations

<strong>A. SUMMARY</strong>
This dataset contains public information on police misconduct cases split up by unique allegations. This includes case numbers, dates of receipt, incident locations, police districts involved, allegations made, investigation findings, issuance dates of findings, and case closure dates. Its purpose is to enhance transparency and accountability by providing accessible details about alleged misconduct to the public. By offering insights into the scope and outcomes of investigations, it enables citizens to stay informed about incidents in their communities, fostering trust and facilitating discussions on police accountability and reform efforts. Access to this dataset empowers individuals to monitor the progress of cases and engage in constructive dialogue to promote positive change in law enforcement practices.

<strong>B. HOW THE DATASET IS CREATED</strong>
The data set is created when a complaint is made to DPA. DPA opens the case and date is developed through out the life of the case.

<strong>C. UPDATE PROCESS</strong>
The data is downloaded once a week from DPA’s Case Management System.

<strong>D. HOW TO USE THIS DATASET</strong>
The dataset includes information on complaints received and closed in the current calendar year. Some cases will display received dates in previous years due to them being closed out in the current year. 

<strong>E. RELATED DATASETS</strong>
<li> <u><a href="https://data.sfgov.org/City-Management-and-Ethics/Police-Accountability-Misconduct-Cases-and-Allegat/b4we-97wx/about_data">Police Accountability Misconduct Cases and Allegations
</a></u>

Organization: City of San Francisco
SFMTA - Parking Citations & Fines

<strong>SUMMARY</strong>
Parking Citations & Fines issued by MTA, Police, and Sheriff. Citation information includes citation, violation and location details which indicate the location and amount of parking citations throughout the city. 

<strong>HOW THIS DATASET IS CREATED</strong>
Citation data is provided by the SFMTA as an export of the citation management system. Citation data is provided daily and the DataSF datasource is updated daily with a 24 hour lag. The geolocation is based on a geocoding process upon load and may not be accurate based on incomplete address data.

<Strong>HOW TO USE THIS DATASET</strong>
For more information on violation codes and descriptions, go <a href="https://www.sfmta.com/sites/default/files/reports-and-documents/2020/10/fy_2021_fees_and_fines_effective_1.1.21.pdf">here</a>.

Tags: parking
Organization: City of San Francisco
Plumbing Permits

This data set pertains to all types of plumbing and mechanical permits. Data includes details on application/permit numbers, job addresses, supervisorial districts, and the current status of the applications. Data is uploaded weekly by DBI. Users can access permit information online through DBI’s Permit Tracking System which is 24/7 at www.sfdbi.org/dbipts.

Tags: construction-permits, permit, permits
Organization: City of San Francisco
Parcels with overlay attributes

<strong>A. SUMMARY</strong>
This dataset is derived from <a href="https://data.sfgov.org/Geographic-Locations-and-Boundaries/Parcels-Active-and-Retired/acdm-wktn">parcels</a> and several other overlay administrative boundaries (listed below). The dataset was developed by DataSF as a convenience for matching parcels to districts where appropriate. This can be simpler than running a geospatial process every time you want to join parcels to a boundary. The districts provided here run along streets and are non-overlapping so that the parcels will be contained within a single district.

The boundaries included are:
1. <a href="https://data.sfgov.org/Geographic-Locations-and-Boundaries/Analysis-Neighborhoods/p5b7-5n3h">Analysis Neighborhoods</a>
2. <a href="https://data.sfgov.org/Geographic-Locations-and-Boundaries/Current-Supervisor-Districts/8nkz-x4ny">Supervisor Districts</a>
3. <a href="https://data.sfgov.org/Public-Safety/Current-Police-Districts/wkhw-cjsf">Police Districts</a>
4. <a href="https://data.sfgov.org/Geographic-Locations-and-Boundaries/Planning-Districts/ttns-6zj3">Planning Districts</a>

<strong>B. HOW THE DATASET IS CREATED</strong>
A script runs daily that overlays parcels with each of the boundaries to produce the composite dataset.

<strong>C. UPDATE PROCESS</strong>
Updated daily by a script based on the upstream parcels dataset which is also updated daily.

<strong>D. HOW TO USE THIS DATASET</strong>
You can use this dataset to match to administrative districts provided here to datasets that contain a parcel number. This can be a simpler process than running these joins spatially. 

In short, we pre-process the spatial overlays to make joins simpler and more performant.

Tags: boundaries, city-reference-data
Organization: City of San Francisco
Campaign Finance - Individual Expenditure Ceilings (IEC)

This table provides information about the Individual Expenditure Ceilings (IEC) for Board of Supervisors and Mayoral candidates. Only candidates who have been certified as eligible to receive public funds are bound by an Individual Expenditure Ceiling (IEC). Each publicly financed BOS candidate's IEC begins at $250,000 and may be raised in increments of $50,000. Each publicly financed Mayoral candidate's IEC begins at $1,475,000 and may be raised in increments of $250,000.

Tags: campaign-finance, candidate, dashboards, iec, individual-expenditure-ceilings, public-financing
Organization: City of San Francisco
Campaign Finance - Summary Totals

<strong>A. SUMMARY</strong>
This dataset contains current summary information for electronically filed FPPC campaign forms. The columns in this dataset correspond to the figures reported on the summary page of FPPC forms 450, 460, 461, and 465. Refer to the <a href="https://fppc.ca.gov/forms.html">FPPC Forms represented in this dataset</a>.

<strong>B. HOW THE DATASET IS CREATED</strong>
Committees file campaign statements with the Ethics Commission on a periodic basis. Those statements are stored with the Commission's provider. Data is generally presented as-filed by committees.
If a committee files an amendment, the data from that filing completely replaces the original and any prior amendments in the filing sequence.

<strong>C. UPDATE PROCESS</strong>
Each night starting at midnight Pacific time a script runs to check for new filings with the Commission's database, and updates this dataset with transactions from new filings. The update process can take a variable amount of time to complete. Viewing or downloading this dataset while the update is running may result in incomplete data, therefore it is highly recommended to view or download this data before midnight or after 8am.

<strong>D. HOW TO USE THIS DATASET</strong>
Transactions from rejected and superseded filings are not included in this dataset. Transactions from many different FPPC forms are combined in this dataset, refer to the column "Form Type" to differentiate transaction types.

A row with no value in the SyncFlag column indicates a paper filing amended an electronic filing. The SFEC is working on how to automatically deal with these cases.

Properties suffixed with "-nid" can be used to join the data between Filers, Filings, and Transaction datasets.

Refer to the <a href="https://sfethics.org/disclosures/campaign-finance-disclosure/campaign-finance-disclosure-data">Ethics Commission's webpage</a> for more information.

<strong>RELATED DATASETS</strong>
<ul>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-San-Francisco-Campaign-Filers/4c8t-ngau">San Francisco Campaign Filers</a></li>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-Filings-Received-by-SFEC/qizs-bwft">Filings Received by SFEC</a></li>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-Summary-Totals/9ggq-m8hp">Summary Totals</a></li>
    <li><a href="https://data.sfgov.org/City-Management-and-Ethics/Campaign-Finance-Transactions/pitq-e56w">Transactions</a></li>
</ul>

Tags: campaign-finance, ethics
Organization: City of San Francisco
Muni Simple Routes

<strong>A. SUMMARY </strong>
Current Muni routes for simple cartographic and spatial analyses.

<strong>B. METHODOLOGY </strong> 
Route data is exported from the Trapeze scheduling system and filtered only for full length patterns.  

<strong>C. UPDATE FREQUENCY   </strong>
Updated by “Sign-up”, when transit system changes are put into effect. Updates range from every 3-6 months. 

<strong>D. OTHER CRITICAL INFO   </strong>
Inbound and Outbound route lines are included and represented with separate polylines for each route. Route numbers 59, 60, 61 are all Cable Car routes.

To identify stops on a route one can use the agency website to compile a list of stops per mode. E.g. sfmta.com/n will give a list of all N stops.

Tags: bus, cable-car, lrv, metro, public-lines, rail, routes, transit-lines, transit-network
Organization: City of San Francisco
Form 700 Schedule B - Interests in Real Property

This dataset is updated weekly. For more up-to-date filings, refer to the "View Filed Statements" or "Search Within Statements" links on the <a href="https://sfethics.org/disclosures/city-officer-disclosure/statement-of-economic-interests-city-officer-disclosure">Ethics Commission webpage</a>.

Interests in Real Property (including rental income) in the jurisdiction
Link to Form 700 overview: http://www.fppc.ca.gov/Form700.html
In this dataset the fields "incomeSources" and "loan_address" are redacted.
This dataset contains records from Schedule B across electronic Form 700 filings with the SFEC since January 1, 2014.  To see all the data from a specific filing, you should search all the datasets listed
<a href="https://sfethics.org/disclosures/city-officer-disclosure/statement-of-economic-interests-city-officer-disclosure/data-statement-of-economic-interests">on this page</a> and filter by the filingId of the specific filing.

Prior to the start of e-filing for all in 2022, elected officials, department heads, and members of boards and Commissions filed the Form 700 with the Ethics Commission; designated employees filed the Form 700 on paper with their department's designated filing officer.

Tags: ethics, form-700, schedules, sei, statement-of-economic-interests
Organization: City of San Francisco
Landmarks Listed in Article 10 of the San Francisco Planning Code

<strong>A. SUMMARY</strong>
Historic Landmarks Listed in Article 10 of the San Francisco Planning Code

<strong>B. HOW THE DATASET IS CREATED</strong>
Created by the the San Francisco Planning Department.  Areas represent parcel boundaries or streets listed in Article 10 of the Planning Code

<strong>C. UPDATE PROCESS</strong>
Automated to refresh daily. The data contents are updated a few times a year when new sites are approved by the Historic Preservation Commission.

<strong>D. HOW TO USE THIS DATASET</strong>
For further information:
https://codelibrary.amlegal.com/codes/san_francisco/latest/sf_planning/0-0-0-27871

Tags: code, historic, planning, preservation
Organization: City of San Francisco
Existing Buildings Energy Performance Ordinance Report

<strong>A. SUMMARY</strong>
The Existing Buildings Energy Performance Ordinance (Environment Code Chapter 20) requires that each non-residential building with at least 10,000 square feet of conditioned (heated or cooled) space and each residential building with at least 50,000 square feet of conditioned space must be benchmarked annually using Energy Star Portfolio Manager. Each non-residential building specified above is also required to undergo an energy audit, retrocommissioning, or develop a plan for decarbonization at least once every 5 years.

More information:
<u><a href="http://www.sfenvironment.org/ebo">San Francisco Existing Buildings Energy Ordinance Website</a></u>

<strong>B. HOW THE DATASET IS CREATED</strong>
The data is sourced from the benchmark and energy audit reports submitted for compliance with Environment Code Chapter 20. The dataset is presented in two tables which together provide basic characteristics, compliance status, and a public record of reported energy performance.

<strong>C. UPDATE PROCESS</strong>
This dataset will be updated on a monthly basis.

<strong>D. HOW TO USE THIS DATASET</strong>
<u><a href="https://data.sfgov.org/Energy-and-Environment/Existing-Buildings-Basic-Info-and-Audit-Compliance/vgqy-2ca4">Existing Buildings - Basic Info and Audit Compliance Status</a></u> -- This filtered view contains one record per building and provides basic characteristics (such as size and vintage). For commercial buildings, the table indicates when an energy audit or decarbonization plan is due.

<u><a href="https://data.sfgov.org/Energy-and-Environment/Existing-Buildings-Benchmark-Reports/4ua7-5sfx">Existing Buildings - Benchmark Reports</a></u> -- Each row of this filtered view presents one year of benchmarking data for one building – so there are multiple records per building. One year of data includes compliance status, and if the building complied it also presents energy use data including gas, electricity, steam and EPA-estimated operational carbon emissions.

This dataset contains the information of the two views joined on Parcel Number.

<strong>E. RELATED DATASETS</strong>
<u><a href="https://data.sfgov.org/d/bfhx-j6n5/">San Francisco Municipal Energy Benchmarking</a></u>

Tags: benchmark, benchmarking, building, buildings, carbon-emissions, energy, greenhouse-gas-emissions
Organization: City of San Francisco
Temporary Street Closures

<strong>A. SUMMARY</strong>
This dataset stores upcoming and current street closures occurring as a result of the  Shared Spaces program, certain special events, and some construction work. This dataset only includes street closures permitted by the San Francisco Municipal Transportation Agency (SFMTA). It doesn’t include street closures managed by other City departments such as Public Works or the Police Department.

<strong>B. HOW THE DATASET IS CREATED</strong>
The data is exported from the Street Closure Salesforce database which is maintained by the SFMTA ISCOTT unit and converted to the geometry of streets and intersections based on closed street extent descriptions.

<strong>C. UPDATE PROCESS</strong>
Database is updated constantly. This report is issued daily.

<strong>D. HOW TO USE THIS DATASET</strong>
Please be aware that this dataset only contains temporary street closure events that are permitted “status = permitted” 

This dataset contains various types of street closures.  If you are looking for a particular type please use the type field to select the appropriate closure type (Ex. type = Shared Space).

<strong>E. RELATED DATASETS</strong>
<li>For intersection points affected by temporary street closures (rather than the street segments provided here), please see the 
<u><a href="https://data.sfgov.org/d/7p5y-sxmu">Temporary Street Closure Intersections</a></u> dataset. </li>
<li>For street closures in the WZDx standard format, see the   
<u><a href="https://data.sfgov.org/d/4ftp-yz2f">Temporary Street Closures in the Work Zone Data Exchange (WZDx) Format</a></u> dataset. </li>

Organization: City of San Francisco
Behested Payments Waivers

<strong>A. SUMMARY</strong>
Campaign and Governmental Conduct Code - Behested Payments Exceptions<br>
Ordinance amending the Campaign and Governmental Conduct Code to modify the rules concerning behested payment solicitations, by 1) excepting solicitations made under certain types of City programs to solicit, request, and contractually obligate charitable donations through competitively procured contracts; 2) narrowing the prohibition against soliciting from persons involved in administrative enforcement, licenses, permits, or other entitlements for use; 3) narrowing the prohibition against soliciting from persons who have attempted to influence legislative or administrative actions; 4) excepting solicitations made in connection with certain types of City contracts; 5) shortening the time periods for the prohibition as to solicitations from City contractors; 6) excepting payments less than $1,000; 7) authorizing the Board of Supervisors to grant waivers by resolution; 8) expanding the prohibition against soliciting from registered lobbyists; and 9) making other clarifying changes.

<strong>B. HOW THE DATASET IS CREATED</strong>
When a resolution for a Behested Payment Waiver  is adopted by the Board of Supervisors and the Mayor it will be added to the dataset.

<strong>C. UPDATE PROCESS</strong>
The dataset will be manually updated when a resolution for a Behested Payment Waiver  is adopted by the Board of Supervisors and the Mayor.

<strong>D. HOW TO USE THIS DATASET</strong>
Click on the attachment line to open a PDF copy of the resolution.

Tags: behested-payment-waiver
Organization: City of San Francisco
Parking Meters

<strong>A. SUMMARY</strong>
Location, cap color and other key attributes of parking meters in San Francisco. Does not include operating schedules or rate schedules.

<strong>B. METHODOLOGY  </strong>
Updated via the SFpark data warehouse (Parking Space Inventory) by meter shop staff, with manual updates sourced from SFMTA CAD drawings and MTAB resolutions. 

<strong>C. UPDATE FREQUENCY  </strong>
Updated weekly.

<strong>D. OTHER CRITICAL INFO   </strong>
For active meters only, filter for "Active_Met" = 'M" or "T". Meter operating and rate schedules are more complex and available as separate tables. Key field for joining is the Parking Space ID field.

Tags: meters, parking-space-inventory, psi
Organization: City of San Francisco
SFEC Departmental Gifts Disclosure Cover Page

<strong>A. SUMMARY</strong>
Section 3.217 of the Campaign and Governmental Conduct Code requires each Department Head to disclose payments that their department receives from a source that is not a federal, state, or local government and for which the department does not provide equal or greater consideration.

Each department accepting gifts will disclose all gifts received during the calendar month from a source that is not a federal, state, or local government. Departments will be expected to submit one disclosure form covering all gifts received in the preceding calendar month, when applicable.

This dataset provides an overview of each department filing, such as the total number of gifts and gift value, filing period, and amendments.

For more information, visit the Ethics Commission’s webpage on <a href="https://sfethics.org/guidance/city-officers/gifts-and-travel-city-officers/gifts-to-city-departments">Gifts to city departments</a>.

<strong>B. HOW THE DATASET IS CREATED</strong>
Data for this dataset is created when departments file the gifts disclosure form provided by the Ethics Commission, starting in December 2024. This form is due within 15 calendar days after the end of the month the department received the gift(s). If a department has not received any gifts in a given month, no filing is necessary.

<strong>C. UPDATE PROCESS</strong>
The dataset is updated via the Socrata Publisher API as needed when form filings are submitted and signed by city departments.

<strong>D. HOW TO USE THIS DATASET</strong>
The unique row identifier for this dataset is “Envelope Id”. Individual filings from departments can be identified by the columns Filing Month, Filing Year, and DepartmentNameLookup. Amendment filings can be identified by the column TypeOfFiling.

<strong>E. RELATED DATASETS</strong>
For detailed information about individual gifts reported by departments, visit the associated dataset, <a href="https://data.sfgov.org/City-Management-and-Ethics/SFEC-Departmental-Gifts-Disclosure-List-of-Gifts/xwsp-i2nc">SFEC Departmental Gifts Disclosure List of Gifts</a>.

A combined view of both datasets is also available: <a href="https://data.sfgov.org/City-Management-and-Ethics/SFEC-Departmental-Gifts-Disclosure-Joined-View/uac5-pxnx/about_data">SFEC Departmental Gifts Disclosure Joined View</a>.

Organization: City of San Francisco
Our415 Events and Activities

<strong>A. SUMMARY</strong>
San Francisco offers numerous events and activities tailored for children, youth, and families. However, finding and navigating the disparate sources of information can be a major challenge. <u><a href="Our415.org">Our415.org</a></u> seeks to simplify this by consolidating all relevant details, ensuring that families can easily find what they need, when they need it. It also encourages discovery of new interests and things to do. This dataset compiles current and upcoming events and activities in San Francisco for children, youth, and their families.

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset is a consolidation of multiple datasets from contributing City agencies and departments as well as Community Based Organizations. Currently, the information in the dataset is sourced from Rec Park’s activities catalog, SF Public Library’s events calendar, Department of Early Childhood’s family events calendar, and Support for Families' family events calendar. Rec Park activities include any “Open” activities appropriate for ages 0-24, and SF Public Library, Department of Early Childhood, and Support for Families events include events going into the next month.

<strong>C. UPDATE PROCESS</strong>
The dataset will be updated on a daily basis, reflecting changes to the source data.

<strong>D. HOW TO USE THIS DATASET</strong>
Taxonomy related fields and eligibility fields are either AI-determined or assigned through a DCYF-created crosswalk. These values are determined for the purposes of categorization and search functionality on Our415.org. Use with caution - errors may exist.

Organization: City of San Francisco