AndreaBozzo/ceres-open-data-index huggingface dataset:
Theory aware Machine Learning (TaML)

A code repository and accompanying data for incorporating imperfect theory into machine learning for improved prediction and explainability. Specifically, it focuses on the case study of the dimensions of a polymer chain in different solvent qualities. Jupyter Notebooks for quickly testing concepts and reproducing figures, as well as source code that computes the mean squared error as a function of dataset size for various machine learning models are included.For additional details on the data, please refer to the README.md associated with the data. For additional details on the code, please refer to the README.md provided with the code repository (GitHub Repo for Theory aware Machine Learning). For additional details on the methodology, see Debra J. Audus, Austin McDannald, and Brian DeCost, "Leveraging Theory for Enhanced Machine Learning"  *ACS Macro Letters* **2022** *11* (9), 1117-1122 DOI: [10.1021/acsmacrolett.2c00369](https://doi.org/10.1021/acsmacrolett.2c00369).

Tags: machine-learning, polymers, theory, transfer-learning
Organization: National Institute of Standards and Technology
Speed of Sound and Density of Difluoromethane

Speed of sound and density measurements for difluoromethane. Speed of sound was measured in the liquid phase using a dual-path pulse-echo instrument at temperatures between 230 and 345 K, with pressures from 2.1 to 70 MPa. Vapor-phase density was measured using a dual-sinker densimeter instrument at temperatures from 240 to 340 K and pressures from 0.1 to 1.61 MPa.

Tags: density, dfm, hfc-32, low-gwp, material-property, r-32, reference-data, speed-of-sound
Organization: National Institute of Standards and Technology
Asynchronous AM Bench 2022 Challenge Data: Real-time, simultaneous absorptance and high-speed Xray imaging

The absolute laser absorption was measured simultaneously with X-ray imaging during laser melting of Ti-6Al-4V solid metal. The data included here are the time-resolved absolute absorbed power and the Xray images acquired at the same time, along with timing data for synchronization. Also included is information about the experimental configuration including applied laser power, laser beam spatial profile, and the experimental setup. A text document is included that describes all files. There are datasets from two experimental configurations: 1) A stationary, 2.0 ms laser pulse and 2) a 700 mm/s scanned laser.

Tags: additive-manufacturing, laser-welding
Organization: National Institute of Standards and Technology
SDNist v1.3: Temporal Map Challenge Environment

SDNist (v1.3) is a set of benchmark data and metrics for the evaluation of synthetic data generators on structured tabular data. This version (1.3) reproduces the challenge environment from Sprints 2 and 3 of the Temporal Map Challenge. These benchmarks are distributed as a simple open-source python package to allow standardized and reproducible comparison of synthetic generator models on real world data and use cases. These data and metrics were developed for and vetted through the NIST PSCR Differential Privacy Temporal Map Challenge, where the evaluation tools, k-marginal and Higher Order Conjunction, proved effective in distinguishing competing models in the competition environment.SDNist is available via `pip` install: `pip install sdnist==1.2.8` for Python >=3.6 or on the [USNIST/Github](https://github.com/usnistgov/Differential-Privacy-Temporal-Map-Challenge-assets/). The sdnist Python module will download data from NIST as necessary, and users are not required to download data manually.

Tags: benchmarks, differential-privacy, privacy, private-information-sharing, synthetic-data
Organization: National Institute of Standards and Technology
Suspect List of Possible Per- and Polyfluoroalkyl Substances (PFAS)

A list of structures (and other identifiers) of possible per- and polyfluoroalkyl substances (PFAS). The data provided in the PFAS Suspect List has been aggregated from public sources and users, including peer-reviewed literature, patent literature, and public websites. Therefore, the quality and accuracy of the compound names, structures, and other properties have not been validated. The National Institute of Standards & Technology does not endorse or provide any assessment of confidence with the information provided.

Tags: environmental, high-resolution-mass-spectrometry, perfluoroalkyl-substances, pfas, polyfluoroalkyl-substances
Organization: National Institute of Standards and Technology
Cleared Margin Reports

Derivatives clearing organizations (DCOs) are required to file daily reports on initial margin with the CFTC's Division of Clearing and Risk (DCR). Aggregate initial margin summary information for Chicago Mercantile Exchange (CME), ICE Clear Credit (ICC), ICE Clear US (ICUS), ICE Clear Europe (ICEU), LCH Ltd., and LCH SA is published below. The information will generally be updated within ten business days of the end of each month.

Tags: exchange, margin
Organization: Commodity Futures Trading Commission
Weekly Swaps Report

The CFTC Swaps Report aggregates a comprehensive body of swap market data that was not previously reported to regulators or regulated entities, and makes that information freely available in a form that is readily usable by both market participants and the general public. The swaps market data included in publications produced by entities such as the BIS, ISDA, and the Office of the Comptroller of the Currency vary in scope and granularity, but none corresponds directly to the data stored in the CFTC's SDRs.

Tags: swaps-market, swaps-report
Organization: Commodity Futures Trading Commission
Development of a CSRML version of the Analog Identification Methodology (AIM) fragments and their evaluation within the Generalised Read-Across (GenRA) approach

Dataset for "Development of a CSRML version of the Analog Identification Methodology (AIM) fragments and their evaluation within the Generalised Read-Across (GenRA) approach.”. 

This dataset is associated with the following publication:
Adams, M., H. Hilde, D. Chang, A. Richard, A. Williams, I. Shah, and G. Patlewicz. Development of a CSRML version of the Analog identification Methodology (AIM) fragments and their evaluation within the Generalised Read-Across (GenRA) approach.   Computational Toxicology. Elsevier B.V., Amsterdam,  NETHERLANDS, 25: 100256, (2023).

Tags: acute-toxicity-ld50, aim, classyfire, csrml, genra, toxprints
Organization: U.S. Environmental Protection Agency
Curation of a list of chemicals in biosolids from EPA National Sewage Sludge Surveys & Biennial Review Reports

Data for "Richman, T., Arnold, E. & Williams, A.J. Curation of a list of chemicals in biosolids from EPA National Sewage Sludge Surveys & Biennial Review Reports. Sci Data 9, 180 (2022). https://doi.org/10.1038/s41597-022-01267-9". 

This dataset is associated with the following publication:
Richman, T., E. Arnold, and A. Williams. Curation of a list of chemicals in biosolids from EPA National Sewage Sludge Surveys & Biennial Review Reports.   Scientific Data. Springer Nature, New York, NY,  9: 180, (2022).

Tags: biennial-review-reports, biosolids, curation, sewage-sludge-surveys
Organization: U.S. Environmental Protection Agency
The NORMAN Suspect List Exchange (NORMAN-SLE): facilitating European and worldwide collaboration on suspect screening in high resolution mass spectrometry

Data and code for "Mohammed Taha, H., Aalizadeh, R., Alygizakis, N. et al. The NORMAN Suspect List Exchange (NORMAN-SLE): facilitating European and worldwide collaboration on suspect screening in high resolution mass spectrometry. Environ Sci Eur 34, 104 (2022). https://doi.org/10.1186/s12302-022-00680-6". 

This dataset is associated with the following publication:
Taha, H.M., R. Aalizadeh, N. Aygizakis, J. Antignac, H.P. Arp, R. Bade, N.C. Baker, L. Belova, L. Bijlsma, E. Bolton, W. Brack, A. Celma, W. Chen, T. Cheng, P. Chirsir, L. Cirka, L. D'Agostino, Y. Djoumbou-Feunang, V. Dulio, S. Fischer, P. Gago-Ferrero, A. Galani, B. Geueke, N. Glowacka, J. Gluge, K. Groh, S. Grosse, P. Haglund, P. Hakkinen, S. Hale, F. Hernandez, E. Janssen, T. Jonkers, K. Kiefer, M. Kirchner, J. Koschorreck, M. Krauss, J. Krier, M. Lamoree, M. Letzel, T. Letzel, Q. Li, J. Little, Y. Liu, D. Lunderberg, J. Martin, A. McEachran, J. McLean, C. Meier, J. Meijer, F. Menger, C. Merino, J. Muncke, M. Muschket, M. Neumann, V. Neveu, K. Ng, H. Oberacher, J. O'Brien, P. Oswald, M. Owaldova, J. Picache, C. Postigo, N. Ramirez, T. Reemtsma, J. Renaud, P. Rostkowski, H. Ruedel, R. Salek, S. Samanipour, M. Scheringer, I. Schliebner, W. Schulz, T. Schulze, M. Sengl, B. Shoemaker, K. Sims, H. Singer, R. Singh, M. Sumarah, P. Thiessen, K. Thomas, S. Torres, X. Trier, A. Van Wezel, R. Vermeulen, J. Vlaanderen, P. Von Der Ohe, Z. Wang, A. Williams, E. Willighagen, D. Wishart, J. Zhang, N. Thomaidis, J. Hollender, J. Slobodnik, and E. Schymanski. The NORMAN Suspect List Exchange (NORMAN-SLE): facilitating European and worldwide collaboration on suspect screening in high resolution mass spectrometry.   Environmental Sciences Europe. Springer Nature, New York, NY,  34: 104, (2022).

Tags: chemicals-of-emerging-concern, cheminformatics, data-exchange, environmental-contaminants, exposomics, fair, high-resolution-mass-spectrometry, non-target-screening, open-science, suspect-screening
Organization: U.S. Environmental Protection Agency
Evaluation of Two Methods for Detection of Viable Bacillus anthracis Simulant Spores in Maritime Environmental Samples

This is a manuscript for a peer-reviewed journal publication of some of the data of the project on “Evaluation of Analytical Methods for Detection of Bacillus anthracis Surrogate Spores: Compatibility with Real-World Maritime Environmental Samples Collected from the U.S. Coast Guard (USCG) Assets and Facilities”, executed under the Department of Homeland Security (DHS) funded Analysis for Coastal Operational Resiliency (AnCOR) program to help the USCG in their efforts to be better prepared to respond to bioterrorism incidents. The manuscript presents the data on the evaluation of performance of the traditional culture (TC) and the rapid viability-polymerase chain reaction (RV-PCR) methods for compatibility with detection of spores of Bacillus thuringiensis subspecies kurstaki (Btk), a surrogate for the anthrax causing Bacillus anthracis, in maritime environmental surface and grab samples. Employing the commonly used surface sampling tools such as Sponge-Sticks and vacuum filter cassettes, samples containing background materials were collected from the response boat-small, response boat-medium, navigation computer screens on these boats, pier concrete, and wood surfaces at the USCG base in Portsmouth, VA. Also collected were grab samples (e.g., grass, gravel, boat wash-water). These samples were spiked in the laboratory with the spores of Bacillus thuringiensis which is commonly used as a surrogate for Bacillus anthracis. The spiked samples were then processed to recover spores and analyzed by the two analytical methods. The performance of these methods was compared and is described in this manuscript. 

This dataset is associated with the following publication:
Nelson, S., K. Hofacre, M. Calfee, S. Serre, E. Benard, C. Graham, L. Oudejans, R. Mickelsen, J. Tang, D. Bansleben, S. Taft, R. James, and S. Shah. Evaluation of Two Methods for Detection of Viable Bacillus anthracis Simulant Spores in Maritime Environmental Samples.   ENVIRONMENTAL MONITORING AND ASSESSMENT. Springer, New York, NY, USA, 195: 257, (2023).

Tags: bacillus-thuringiensis-spores, maritime-environmental-sample-analysis, rv-pcr-method, traditional-culture-method
Organization: U.S. Environmental Protection Agency
Property Data with Geographic Identifiers

These datasets are clones of popular WPRDC datasets from various publishers that have been reverse-geocoded to add geographic identifiers (e.g., municipality and neighborhood).  

Follow the links in the file descriptions for more information on the original datasets.

If you get a timeout error when trying to download either "Property Assessment Parcel Data" or "Property Assessment Data with Parcel Centroids", click on the Preview link and use the alternative download link (which should contain the term "downstream").

Tags: _etl, assessment, parcel, property, real-estate, sales
Organization: Allegheny County / City of Pittsburgh / Western PA Regional Data Center
Program Listing

​​In 2004, the Homeland Security Act was modified to establish the PPBE system as the means by which DHS allocates resources and directs programmed resources to be reported in the Future Years Homeland Security Program (FYHSP).  The intent is to ensure that resource proposals and budget execution are examined from a broader perspective which are linked to and follow strategy.  This system is comprised of four (sometimes overlapping) phases:rn- Planning establishes strategic priorities and capabilities required to achieve the strategy;rn- Programming applies the resources to “Programs and looks at alternatives to providing capabilities required to achieve the strategic priorities;rn- Budgeting properly prices the Programs, develops justifications, and an execution plan; andrn- Execution performs and monitors the approved plan.

Tags: budget, execution, planning, program
Organization: Department of Homeland Security
Authoritative and/or Trusted Data Detail Report

Displays Documented Authoritative and/or Trusted data assets and the relevant associated Datasets. Published data assets that are considered documented have met the appropriate criteria. An Authoritative data asset must have a Legal Authority associated to it. A Trusted data asset must have a Yes selected for the following fields: Logical Data Model (LDM) Available, Data Management Plan (DMP) Completed, and Data Quality Plan (DQP) in Use. A data asset identified as Both must fulfill the criteria for Authoritative and Trusted. Datasets associated to a Producer data asset can also be identified as Authoritative and/or Trusted and are included in this report.

Tags: data-asset, dataset, report
Organization: Department of Homeland Security
Anticipated Systems Not Mapped to Published Data Assets Report

Displays Anticipated Systems not mapped to a Published data asset. An Anticipated System can be described as a system expected to have at least one associated data asset. It excludes systems exclusively designated as Network, WAN, Web Server and has a Lifecycle Configuration Status as Canceled, Decommission, Deleted, Development, Discontinued, Disposal, or Renamed. This report can be used to help improve the Percentage of Data Assets to Anticipated Systems Mapped Score from Enterprise Data Management (EDM) Scorecard by identifying which anticipated system need to be mapped to a data asset.

Tags: data-asset, dataset, fisma-system
Organization: Department of Homeland Security
USSS TRM Service REST API

Technical Reference Model (TRM) is a set of categorized software and non-commodity hardware products that is the starting point for all IT purchases at the Department. It also includes the associated status of each software and hardware such as approved, prohibited, restricted, etc. This is a searchable reference model governed by TRM as a Service (TRMaaS).  This service lists only those products that have been govern by the United States Secret Service.

Tags: api, governance, rest, technology, technology-governance
Organization: Department of Homeland Security
TRM Component Baseline REST API

Technical Reference Model (TRM) is a set of categorized software and non-commodity hardware products that is the starting point for all IT purchases at the Department. It also includes the associated status of each software and hardware such as approved, prohibited, restricted, etc. This is a searchable reference model governed by TRM as a Service (TRMaaS).

Tags: api, governance, rest, technology, technology-governance
Organization: Department of Homeland Security
FEMA FISMA System Inventory REST API

A system is identified by constructing logical boundaries around a set of processes, communications, storage, and related resources. The elements within these boundaries constitute a single system requiring a security plan. Each element of the system must (1) be under the same direct management control, (2) have the same function or mission objective, (3) have essentially the same operating characteristics and security needs, and (4) reside in the same general operating environment.  This service produces a list of FISMA Systems that belong to FEMA.

Tags: api, application, fisma, rest, system
Organization: Department of Homeland Security
FISMA System Inventory REST API

A system is identified by constructing logical boundaries around a set of processes, communications, storage, and related resources. The elements within these boundaries constitute a single system requiring a security plan. Each element of the system must (1) be under the same direct management control, (2) have the same function or mission objective, (3) have essentially the same operating characteristics and security needs, and (4) reside in the same general operating environment.  This service produces a list of FISMA Systems that belong to DHS Components.

Tags: api, application, fisma, rest, system
Organization: Department of Homeland Security
DHS Strategic Plan

The U.S. Department of Homeland Security's Strategic Plan for Fiscal Years 2020-2024 fulfills the GPRA Modification Act of 2010 (P.L. 111-352) and the Office of Management and Budget's Circular A-11, Part 6 (2013) requirement for all Federal departments and agencies to publish an Agency Strategic Plan. The FY20-24 Strategic Plan provides an analytic foundation for the Department's Unity of Effort Initiative by articulating the Department's missions and goals, the strategies we employ to achieve each goal, and long-term performance that we use to evaluate our progress.

Tags: plan, strategy
Organization: Department of Homeland Security
Metadata for "Limiting Wind-Induced Resuspension of Radioactively Contaminated Particles to Enhance First Responder, Early Phase Worker and Public Safety—Part 1"

Data represented in the figures in the article. This dataset is not publicly accessible because: It is owned by non-EPA authors. It can be accessed through the following means: Contact non-EPA authors listed on publication. 

Hadas Raveh-Amit, hadasa@nrcn.gov.il
Avi Sharon, avish@nrcn.gov.il
Itzhak Katra, katra@bgu.ac.il. Format: Unknown. 

This dataset is associated with the following publication:
Raveh-Amit, H., A. Sharon, I. Katra, T. Stilman, S. Serre, J. Archer, and M. Magnuson. Limiting Wind-Induced Resuspension of Radioactively Contaminated Particles to Enhance First Responder, Early Phase Worker and Public Safety—Part 1.   Applied Sciences. MDPI, Basel,  SWITZERLAND, 12(5): 2463, (2022).

Tags: containment-mitigation, contaminant-persistence, indoor-outdoor-decontamination, radiological-contamination
Organization: U.S. Environmental Protection Agency
Community Navigator Pilot Program Grantees

The Community Navigator Pilot Program supports a network of organizations committed to serving small businesses and entrepreneurs in underserved communities.
This network uses a 'Hub and Spoke' model: a centralized 'Hub' coordinates and supports local 'Spoke' organizations on the ground. 
The attached spreadsheet contains lists of Hub and Spoke organizations:
On the 'Hubs' tab, each Hub has a link to its website. Note that some Hubs may be located in one city or state, but support Spokes that serve a wider region.
On the 'Spokes' tab, each Spoke is connected to its Hub.
Each of the 51 Community Navigator projects falls into one of three tiers, related to the geographic reach of that project:
Tier 1 - national level:
(8 awards, max $5M per award)
Organizations support a minimum of five service areas (not within the same state), containing a population greater than 500,000.
Tier 2 - state/local level:
(11 awards, max $2.5M per award)
Organizations support an individual state, region, municipality, or city with total service population of greater than or equal to 500,000.
Tier 3 - local level:
(32 awards, max $1M per award)
Organizations support a region, municipality, city, tribal or rural community with total service population of less than 500,000.

Tags: cnpp, covid-19, sba
Organization: Small Business Administration
Small Business Procurement Scorecard Overview

The annual Small Business Procurement Scorecard is an assessment tool to (1) measure how well federal agencies reach their small business and socio-economic prime contracting and subcontracting goals, (2) provide accurate and transparent contracting data and (3) report agency-specific progress. The prime and subcontracting component goals include goals for small businesses, small businesses owned by women (WOSB), small disadvantaged businesses (SDB), service-disabled veteran-owned small businesses (SDVOSB), and small businesses located in Historically Underutilized Business Zones (HUBZones).  Each federal agency has a different small business contracting goal, negotiated annually in consultation with SBA. SBA ensures that the sum  total of all of the goals meets the 23 percent target established by law.

Tags: procurement, sba, scorecard, small-business
Organization: Small Business Administration
Small Business Profiles for the States and Territories - 2009

The Office of Advocacy’s Small Business Profiles are an annual portrait of each state’s small business. They gather the latest federal data into state-by-state snapshots of small business health and economic activity. Limited economic data is also provided for the U.S. territories.  This year’s profiles report on state economic growth and employment, income and finance, employer business owner demographics, turnover among establishments with employees, international trade, small business employment by industry and county, and self-employment by county, and small businesses by industry.

Tags: 2009, all-states, borrowing, exporting, sba, states, territories
Organization: Small Business Administration
Small Business Profiles for the States and Territories - 2010

latest federal data into state-by-state snapshots of small business health and economic activity. Limited economic data is also provided for the U.S. territories.  This year’s profiles report on state economic growth and employment, income and finance, employer business owner demographics, turnover among establishments with employees, international trade, small business employment by industry and county, and self-employment by county, and small businesses by industry.

Tags: 2010, all-states, borrowing, exporting, sba, states, territories
Organization: Small Business Administration
TRM Service REST API

Technical Reference Model (TRM) is a set of categorized software and non-commodity hardware products that is the starting point for all IT purchases at the Department. It also includes the associated status of each software and hardware such as approved, prohibited, restricted, etc. This is a searchable reference model governed by TRM as a Service (TRMaaS).

Tags: api, governance, rest, technology, technology-governance
Organization: Department of Homeland Security
Small Business Profiles for the States and Territories - 2022

The Office of Advocacy’s Small Business Profiles are an annual portrait of each state’s small business. They gather the latest federal data into state-by-state snapshots of small business health and economic activity. Limited economic data is also provided for the U.S. territories.  This year’s profiles report on state economic growth and employment, income and finance, employer business owner demographics, turnover among establishments with employees, international trade, small business employment by industry and county, and self-employment by county, and small businesses by industry.

Tags: 2022, all-states, borrowing, exporting, sba, states, territories
Organization: Small Business Administration