AndreaBozzo/ceres-open-data-index huggingface dataset:
Registered Business Locations - San Francisco

<strong>NEW!</strong>: Use the new <u><a href="https://data.sfgov.org/stories/s/k6sk-2y6w">Business Account Number lookup tool</a></u>. 

<strong>SUMMARY</strong>
This dataset includes the locations of businesses that pay taxes to the City and County of San Francisco. Each registered business may have multiple locations and each location is a single row. The Treasurer & Tax Collector’s Office collects this data through business registration applications, account update/closure forms, and taxpayer filings. Business locations marked as “Administratively Closed” have not filed or communicated with TTX for 3 years, or were marked as closed following a notification from another City and County Department. 

The data is collected to help enforce the Business and Tax Regulations Code including, but not limited to: Article 6, Article 12, Article 12-A, and Article 12-A-1. http://sftreasurer.org/registration.

<strong>HOW TO USE THIS DATASET</strong>
<li><strong>System migration in 2014:</strong> When the City transitioned to a new system in 2014, only active business accounts were migrated. As a result, any businesses that had already closed by that point were not included in the current dataset.
<li><strong>2018 account cleanup:</strong> In 2018, TTX did a major cleanup of dormant and unresponsive accounts and closed approximately 40,000 inactive businesses.

To learn more about using this dataset watch <u><a href="https://www.youtube.com/watch?v=_JO-s2j30qQ">this video</a></u>.
To update your listing or look up your BAN see this FAQ: 
 <u><a href="https://sfdigitalservices.gitbook.io/dataset-explainers/registered-business-locations-faq">Registered Business Locations Explainer</a></u>

Tags: business
Organization: City of San Francisco
Blue Curb Spaces

<strong>A. SUMMARY</strong>
Location of blue curb space devoted to accessible parking.

<strong>B. METHODOLOGY</strong>
SFpark surveys and data creation, 2008-2011.

<strong>C. UPDATE FREQUENCY</strong>
Updated regularly, approx once per quarter.

<strong>D. OTHER CRITICAL INFO</strong>
Drivers with disabled placards can park at any metered space for free and with no time limits; they are not limited to blue zones.

Tags: accessible-parking, blue-zones, color-curb, colored-curb, curb, on-street-parking, sfpark
Organization: City of San Francisco
COVID-19 Deaths Over Time

<strong>A. SUMMARY</strong>
This dataset represents San Francisco COVID-19 related deaths by day. This data may not be immediately available for recently reported deaths. Data updates as more information becomes available. Because of this, death totals for previous days may increase or decrease. More recent data is less reliable.

<strong>B. HOW THE DATASET IS CREATED</strong>
As of January 1, 2023, COVID-19 deaths are defined as persons who had COVID-19 listed as a cause of death or a significant condition contributing to their death on their death certificate. This definition is in alignment with the California Department of Public Health and the national <a href = "https://preparedness.cste.org/wp-content/uploads/2022/12/CSTE-Revised-Classification-of-COVID-19-associated-Deaths.Final_.11.22.22.pdf">Council of State and Territorial Epidemiologists</a>. Death data is provided by the California Department of Public Health.

It takes time to process this data. Because of this, death totals may increase or decrease over time.

Data are continually updated to maximize completeness of information and reporting on San Francisco COVID-19 deaths.

<strong>C. UPDATE PROCESS</strong>
Updates automatically at 06:30 and 07:30 AM Pacific Time on Wednesday each week.

Dataset will not update on the business day following any federal holiday.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset shows new deaths and cumulative deaths by date of death. New deaths are the count of deaths on that specific date. Cumulative deaths are the running total of all San Francisco COVID-19 deaths up to the date listed.

Use the <a href="https://data.sfgov.org/d/kkr3-wq7h">Deaths by Population Characteristics Over Time dataset</a> to see deaths by different subgroups including race/ethnicity, age, and gender.

<strong>E. CHANGE LOG</strong> 
<UL><LI>9/11/2023 – on this date, we began using an updated definition of a COVID-19 death to align with the California Department of Public Health. This change was applied to COVID-19 deaths retrospectively beginning on 1/1/2023. More information about the recommendation by the Council of State and Territorial Epidemiologists that motivated this change can be found <a href = "https://preparedness.cste.org/wp-content/uploads/2022/12/CSTE-Revised-Classification-of-COVID-19-associated-Deaths.Final_.11.22.22.pdf">here</a>. 
<LI>4/6/2023 - the State implemented system updates to improve the integrity of historical data. 
<LI>1/22/2022 - system updates to improve timeliness and accuracy of cases and deaths data were implemented.</UL>

Organization: City of San Francisco
Department of Public Works Permits issued by Clariti

<strong>A. SUMMARY</strong>
List of Department of Public Works Permits issued from the new Clariti permitting system. This dataset currently contains permit information on four permit types (Inspection ROW conformity, Sidewalk Repair, Street Space, Temporary Occupancy). For all other DPW issued permits, see related datasets below.

<strong>B. HOW THE DATASET IS CREATED</strong>
This data are extracted from the Clariti system which is hosted on Salesforce.  This extract is then used to generate this dataset.

<strong>C. UPDATE PROCESS</strong>
An extract from the Salesforce objects relating to the Clariti permits occurs once every 2 days (for now).  This extract is then used to generate this dataset.

<strong>D. HOW TO USE THIS DATASET</strong>
Use this dataset to see the status of permits issued or reviewed by the Department of Public Works for the four following permit types 
- Inspection ROW conformity
- Sidewalk Repair
- Street Space
- Temporary Occupancy 

For all other DPW issued permits, see related datasets below.

<strong>E. RELATED DATASETS</strong>
Mobile Food Facility Permit
https://data.sfgov.org/d/rqzj-sfat

Active Street-Use Permits
https://data.sfgov.org/d/x8nh-xzn6

Parklet Permits
https://data.sfgov.org/d/jczu-j2ku

Various Permits
https://data.sfgov.org/browse?q=permit&sortBy=relevance&page=1&pageSize=20

Organization: City of San Francisco
Our415 - Schedule Information

<strong>A. SUMMARY</strong>
San Francisco offers numerous events and activities tailored for children, youth, and families. However, finding and navigating the disparate sources of information can be a major challenge. Our415.org seeks to simplify this by consolidating all relevant details, ensuring that families can easily find what they need, when they need it. It also encourages discovery of new interests and things to do. This dataset includes the regularly scheduled service days and times for children, youth and family services.

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset includes data collected from various sources including DCYF’s Contract Management System, Jotform, the SF Service Guide, and data shares from various departments in the City. 

<strong>C. UPDATE PROCESS</strong>
The dataset will be updated on a daily basis, reflecting changes to the source data. 

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be joined to the Services dataset (CHF-0013) using the ID field from the Services dataset and service_id field in the Schedule Information dataset.

Organization: City of San Francisco
Inventory of citywide enterprise systems of record

<strong>A. SUMMARY</strong>
In compliance with CA Government Code 6270.5 (passed via SB 272), the City must publish a catalog of enterprise systems that collect data about the public. There are certain exceptions to this detailed in the Government Code. 

<a href="https://leginfo.legislature.ca.gov/faces/codes_displayText.xhtml?lawCode=GOV&division=10.&title=1.&part=3.&chapter=2.&article=3.">The code is available here</a>.

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset is collated through 2 ways:
1. Ongoing updates are made throughout the year to reflect new or retired systems, this process involves DataSF staff reconciling records at the request of departments
2. Annual bulk updates - departments review their inventories and identify changes and updates and submit those to DataSF for a once a year bulk update - not all departments will have changes or their changes will have been captured over the course of the prior year already as ongoing updates

<strong>C. UPDATE PROCESS</strong>
The dataset changes infrequently and is uploaded manually as needed by DataSF staff

<strong>D. HOW TO USE THIS DATASET</strong>
<em>Companion dataset inventory dataset</em>
A companion <a href="https://data.sfgov.org/City-Management-and-Ethics/Dataset-inventory/y8fp-fbf5">dataset of inventoried and published datasets can be accessed online</a> as well.

Tags: gov-code-6270-5, inventory, open-data, ref-inventory, sb-272, sb272, systems
Organization: City of San Francisco
Purchasing Commodity Data

The San Francisco Controller's Office maintains a database of purchasing activity from fiscal year 2007 forward. This data is presented on the Purchasing Commodity Data report in CSV format, and represents detailed commodity-level data by purchase order. Additional lines have been added to this dataset to reconcile some document totals from the City's purchasing system to the totals from the City's accounting system in cases when the two amounts are different, which sometimes occurs due to adjustments entered into the accounting system but not the purchasing system. We have removed sensitive information from this data – this is intended to show payments made to entities providing goods and services to the City and County and to protect individuals. For example, we have removed payments to employees (reimbursements, garnishments) and jury members, revenue refunds, payments for judgments and claims, witnesses, relocation and rehousing, and a variety of human services payments. New data is added on a weekly basis.

Supplier payments represent payments to City contractors and vendors that provide goods and/or services to the City. Certain other non-supplier payee payments, which are made to parties other than traditional City contractors and vendors, are also included in this dataset, These include payments made for tax and fee refunds, rebates, settlements, etc.

Tags: amount, commodity, procurement, purchase-order, purchasing, spending, vendor
Organization: City of San Francisco
Inventory of web domains managed by City and County departments

<strong>A. SUMMARY</strong>
This is an open data set of all known City domains with associated registrar, department, and owner information. The City and County of San Francisco (City) seeks to serve the public with trustworthy, consistent, reliable and safe websites, regardless of department or service. To accomplish this goal, the <u><a href="https://media.api.sf.gov/documents/Domain_Registration_and_Management_Policy_-Approved_1-16-2025_gukZcfQ.pdf">Domain Registration and Management Policy</a></u> standardizes and unifies the internet domain process.  

<strong>B. HOW THE DATASET IS CREATED</strong>
Digital Services audited all city-owned websites and compiled this data in coordination with department stakeholders. 

<strong>C. UPDATE PROCESS</strong>
This dataset will update daily.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be used to track the status of city-owned websites.

<strong>E. KNOWN USES</strong>
This dataset is essential for Department of Technology and Digital Services to create a plan for City-owned websites and email to move to the SF.gov domain or a subdomain by June 30, 2026. In compliance with AB1637 and the Domain Registration and Management Policy, all San Francisco government websites must migrate to a .gov domain by January 1, 2028.

Organization: City of San Francisco
SFEC Form 126F Filings

<strong>A. SUMMARY</strong>
This dataset combines the names of Entities, Affiliates, and Subcontractors which are reported on Form 126f4 or 126f2.

Candidates for City elective office are prohibited under certain circumstances from accepting campaign contributions from parties named on Form 126f2 or 126f4. For more information, visit the <a href="https://sfethics.org/guidance/city-officers/city-contracts">Ethics Commission's City Contracts page</a>.

<strong>B. HOW THE DATASET IS CREATED</strong>
During the contracting process, department contracting officers enter information into the City's ServiceNow system of record. City elective officers or their representatives are sent approval requests at the appropriate stage, which are recorded as Filings with the Ethics Commission. After a filing is approved or completed, records of the filing will appear on this dataset.

Each City agency seeking to enter into a contract that has a total anticipated or actual value of $100,000 or more must file form 126f2 with the Ethics Commission within 30 days of the submission of a proposal.

Each City elective officer who approves a contract that has a total anticipated or actual value of $100,000 or more must file form 126f4 with the Ethics Commission within five business days of approval by: (a) the City elective officer, (b) any board on which the City elective officer serves, or (c) the board of any state agency on which an appointee of the City elective officer serves. 

<strong>C. UPDATE PROCESS</strong>
The data is automatically extracted from ServiceNow on a nightly schedule.

<strong>D. HOW TO USE THIS DATASET</strong>
Certain columns are only applicable to the 126f2, while others are only applicable to the 126f4; Refer to the column descriptions.

A single filing of the 126f form may appear on multiple rows of this dataset, with each row representing a unique affiliate or contractor associated with the contract.

The column "Office or Board" indicates the elected office to which the political contributions prohibition is applied.

<strong>E. RELATED DATASETS</strong>
For 126F filings that were previously submitted via DocuSign:
<a href="https://data.sfgov.org/d/m2xc-rbc2/about_data">126f4 - Contract Approvals List</a>
<a href="https://data.sfgov.org/d/pv99-gzft/about_data">126f2 - Notifications of Submission of Proposal</a>

Organization: City of San Francisco
Covid-19 Pit Stops

<strong>A. SUMMARY</strong>
This dataset contains the locations of all Pit Stops in San Francisco, including those added during the COVID emergency. The Pit Stop program is managed by San Francisco Public Works and aims to provide clean and safe public toilets, sinks, used needle receptacles and dog waste stations in San Francisco's most impacted neighborhoods. In response to the COVID emergency, additional Pit Stops have been added across the City in order to ensure everyone has access to clean and safe toilets and sinks.

Learn more about this Pit Stop Program: https://sfpublicworks.wixsite.com/pitstop

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset is linked to the Pit Stop Program's map of pit stops and updated daily to match that map.

<strong>C. UPDATE PROCESS</strong>
Automatically updated daily at 7am.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be used with other geospatial layers to look at the distribution of Pit Stops in relation to other resources or points of interest. It's important to note that Pit Stops are not the only public restrooms in the City (there are many managed by the Parks Department, for example), and there are additional hand-washing stations that have been distributed during the COVID emergency that are not shown here. This dataset only includes Pit Stops and should not be used to assess broader access to bathrooms, water, or syringe disposal.

Tags: bathroom, covid, handwashing, pit-stop, pitstop, public-bathroom, restroom, sink, toilet
Organization: City of San Francisco
Mental Health (MH) and Substance Use Disorder (SUD) Provider Directory - Provider List

<STRONG>A. SUMMARY</STRONG>
This dataset contains information of Mental Health (MH) and Substance Use Disorder (SUD) programs / sites. It serves as provider directory for the general public to know and search for MH and SUD programs / sites contracted with the City and County of San Francisco. 

<STRONG>B. HOW THE DATASET IS CREATED</STRONG>
The dataset is pulled from our electronic systems. 

<STRONG>C. UPDATE PROCESS</STRONG>
The dataset is updated nightly through sf.gov through Application Programming Interface (API) whenever there are changes. There is monthly review and tracking. 

<STRONG>D. HOW TO USE THIS DATASET</STRONG>
There are filters for some data fields for quick search. For example, if we want to search all MH and SUD programs that serve women, we would use the Gender filter and select “Women” and “All”.

<STRONG>E. RELATED DATASETS</STRONG>

Organization: City of San Francisco
Form 700 Schedule A1 - Investments: Stocks, Bonds, and Other Interests

This dataset is updated weekly. For more up-to-date filings, refer to the "View Filed Statements" or "Search Within Statements" links on the <a href="https://sfethics.org/disclosures/city-officer-disclosure/statement-of-economic-interests-city-officer-disclosure">Ethics Commission webpage</a>.

Investments in stocks, bonds, and other interests where ownership interest is less than 10% (including those held in IRA or 401K)
Link to Form 700 overview: http://www.fppc.ca.gov/Form700.html

This dataset contains records from Schedule A1 across electronic Form 700 filings with the SFEC since January 1, 2014.  To see all the data from a specific filing, you should search all the datasets listed
<a href="https://sfethics.org/disclosures/city-officer-disclosure/statement-of-economic-interests-city-officer-disclosure/data-statement-of-economic-interests">on this page</a> and filter by the filingId of the specific filing.

Prior to the start of e-filing for all in 2022, elected officials, department heads, and members of boards and Commissions filed the Form 700 with the Ethics Commission; designated employees filed the Form 700 on paper with their department's designated filing officer.

Tags: ethics, form-700, schedules, sei, statement-of-economic-interests
Organization: City of San Francisco
Our415 - Service at Locations for Children, Youth, and their Families

<strong>A. SUMMARY</strong>
San Francisco offers numerous events and activities tailored for children, youth, and families. However, finding and navigating the disparate sources of information can be a major challenge. Our415.org seeks to simplify this by consolidating all relevant details, ensuring that families can easily find what they need, when they need it. It also encourages discovery of new interests and things to do. This dataset includes data on which services are provided at a given location.

<strong>B. HOW THE DATASET IS CREATED</strong>
This dataset includes data collected from various sources including DCYF’s Contract Management System, Jotform, the SF Service Guide, and data shares from various departments in the City.

<strong>C. UPDATE PROCESS</strong>
The dataset will be updated on a daily basis, reflecting changes to the source data.

<strong>D. HOW TO USE THIS DATASET</strong>
This dataset can be joined to the Services dataset (CHF-0013) using the ID field from the Services dataset and service_id field in the Service at Locations dataset. It can also be joined to the Locations dataset (CHF-0014) using the ID field from the Locations dataset and the location_id field in the Service at Locations dataset.

<strong>E. RELATED DATASETS</strong>

<strong>F. KNOWN USES (please add)</strong>
Our415.org

Tags: our415
Organization: City of San Francisco
Vendor Payments (Vouchers)

The San Francisco Controller's Office maintains a database of payments made to vendors from fiscal year 2007 forward. This data is presented on the Vendor Payments report hosted at http://openbook.sfgov.org, and is also available in this dataset in CSV format, which represents detailed data by voucher. We have removed sensitive information from this data – this is intended to show payments made to entities providing goods and services to the City and County and to protect individuals. For example, we have removed payments to employees (reimbursements, garnishments) and jury members, revenue refunds, payments for judgments and claims, witnesses, relocation and rehousing, and a variety of human services payments. New data is added on a weekly basis.

City Department spending may occur three ways: 1) from Contract to Purchase Order (i.e. a PO with an accounting Encumbrance) to Payment (i.e. an accounting Voucher), AKA On-Contract spending, 2) direct-to-Purchase Order (no contract, only a PO agreement and accounting Encumbrance) to Payment, and 3) Direct Voucher Payment (for limited one-time, non-recurring payments, e.g. a membership or a subscription).  Therefore, it is helpful to use both the Supplier Contracts and Supplier Payments reports on SFOpenBook, as well as on DataSF.

Supplier payments represent payments to City contractors and vendors that provide goods and/or services to the City. Certain other non-supplier payee payments, which are made to parties other than traditional City contractors and vendors, are also included in this dataset, These include payments made for tax and fee refunds, rebates, settlements, etc.

Tags: amount, open-book, openbook, sfopenbook, spending, vendor, voucher
Organization: City of San Francisco
Notices of Violation issued by the Department of Building Inspection

These records indicate the actual violations and comments by the inspector found during the inspection. The data should be sorted on the Complaint Number field and the Item Sequence Number field.  The user should be able to link this file with the <u><a href="https://data.sfgov.org/d/gm2e-bten">Department of Building Inspection Complaints dataset</a></u> to get a more accurate picture of the violations.

Tags: code-violations
Organization: City of San Francisco
City Facilities

City-owned and leased facilities maintained in the City's Facility System of Record (FSR). Does not include the following agencies which are not part of the City and County of San Francisco: SFHA, OCII and City College.
This dataset was developed through a process involving some of the primary stewards for the facility data and their stakeholders. It is meant to be a living reference and will be maintained and updated through established workflows and processes over time.  You can access the attached User Guide for more detail by clicking the red About button and scrolling to attachments.

Tags: facility, public-buildings, public-facilities
Organization: City of San Francisco
Boiler Permits

This data set pertains to all permits to operate boilers. Data includes details on application/permit numbers, job addresses, supervisorial districts, and the current status of the applications. Data is uploaded weekly by DBI. Users can access permit information online through DBI’s Permit Tracking System which is 24/7 at www.sfdbi.org/dbipts.

Tags: construction-permits, permit, permits
Organization: City of San Francisco
Eviction Notices

<strong> Note 2/27/2024: There was a previous issue with this dataset that created duplicate rows for each record. This issue has been fixed. </strong>

Data includes eviction notices filed with the San Francisco Rent Board per San Francisco Administrative Code 37.9(c). A notice of eviction does not necessarily indicate that the tenant was eventually evicted, so the notices below may differ from actual evictions. Notices are published since January 1, 1997.

Tags: eviction-notices, protected-status, rent-control
Organization: City of San Francisco