AndreaBozzo/ceres-open-data-index huggingface dataset:
Enhanced Master Station History Report

The Enhanced Master Station History Report (EMSHR) is a compiled list of basic, historical information for every station in the station history database, beginning in the 1700s through the present. The Enhanced MSHR version contains similar data elements and is in a similar format as the Standard/Legacy MSHR (DSI-9767_01), but the Enhanced MSHR includes additional stations that are included in the Global Historical Climatology Network (GHCN)-Daily product. Also, the Enhanced MSHR incorporates additional station networks, including international stations/networks. The Enhanced MSHR contains an expanded number of items to the original MSHR, such as station status, additional IDs, alternate station names, NWS region, NWS Weather Forecast Office (WFO), all elevations, latitude/longitude precision, and UTC offset.

Tags: coastal stations, continent, doc/noaa/nesdis/ncdc, doc/noaa/nesdis/ncei, earth science, fixed observation stations, geographic region, ghcn, global, global historical climatology network, ground stations, land surface, meteorological station, national centers for environmental information, national climatic data center, nesdis, noaa, north america, u.s. department of commerce, united states of america, vertical location, weather stations
Organization: National Oceanic and Atmospheric Administration, Department of Commerce
NOAA/NWS Arkansas-Red Basin River Forecast Center (ABRFC) Hourly Quantitative Precipitation Estimates (QPE)

The NWS River Forecast Center (RFC) Quantitative Precipitation Estimation (QPE) products are generated by the P3/MPE/Mountain Mapper software, which use a combination of radar and rain gauge data to construct QPE on 1 hr time scales. Rain gauge data are used to bias-correct the radar data and additional quality control (QC) is performed. The original products are in an XMRG format interpolated to 4 km grid and projected in the Hydrologic Rainfall Analysis Project (HRAP) grid coordinate system, a polar stereographic projection true at 60 degrees North by 105 degrees West. A CF-compliant netCDF format of the data is also available for the purpose of expanding the data use in hydrologic applications. The Arkansas-Red Basin RFC (ABRFC) is a regional center that forecasts river flows and stages for floods, navigation, recreation and water management for the Arkansas River Basin from near Leadville, CO to Pine Bluff, AR and the Red River Basin from the northern mountains of New Mexico to Fulton, AR. The data period of record begins in October 1995 and continues daily in operations. Data are stored and available in netCDF and Hydrological XMRG file formats.

Tags: arkansas, atmosphere, colorado, continent, doc/noaa/nesdis/ncdc, doc/noaa/nesdis/ncei, earth science, land surface, liquid precipitation, national centers for environmental information, national climatic data center, nebraska, nesdis, new mexico, noaa, north america, oklahoma, precipitation, precipitation amount, rain, texas, u.s. department of commerce, united states of america, vertical location
Organization: National Oceanic and Atmospheric Administration, Department of Commerce
Dissolved inorganic carbon, temperature, salinity and other variables collected from discrete sample and profile observations using CTD, Coulometer for DIC measurement and other instruments from the HOKKO MARU in the North Pacific Ocean from 2003-06-09 to 2003-06-17 (NCEI Accession 0112221)

This dataset includes chemical, discrete sample, physical and profile data collected from HOKKO MARU in the North Pacific Ocean from 2003-06-09 to 2003-06-17 and retrieved during cruise HK0306 and PACIFICA_49H520030609. These data include DISSOLVED INORGANIC CARBON, HYDROSTATIC PRESSURE, NITRATE + NITRITE CONTENT (CONCENTRATION), PHOSPHATE, SALINITY, SILICATE and WATER TEMPERATURE. The instruments used to collect these data include CTD, Coulometer for DIC measurement and bottle. These data were collected by Tsuneo Ono of (NRIFS) National Research Institute of Fisheries Science as part of the PACIFICA_49H520030609 dataset.

PACIFICA (PACIFic ocean Interior CArbon) was an international collaborative project for the data synthesis of ocean interior carbon and its related parameters in the Pacific Ocean. The North Pacific Marine Science Organization (PICES), Section of Carbon and Climate (S-CC) supported the project.

Tags: 49h520030609, ctdtmp, dic, discrete measurement, hk0306, no2+no3, ocean carbon and acidification data system (ocads) project, oceanography, pacific ocean, pacifica_49h520030609, phspht, profile, salnty, silcat, tcarbn
Organization: National Oceanic and Atmospheric Administration, Department of Commerce
HRRR Meteorology, Energy, and Transmission (MET) Toolkit

The HRRR MET (Meteorology, Energy, and Transmission) Toolkit is the National Laboratory of the Rockies' (NLR) new flagship atmospheric dataset, designed to support comprehensive long-term planning and operations across the entire power sector. Serving as the direct successor to the legacy WIND Toolkit, this dataset provides a continuously updatable, high-fidelity meteorological record covering the Continental United States (CONUS). To ensure a seamless transition for modelers conducting multi-decadal grid integration and capacity expansion studies, the HRRR MET Toolkit is delivered at an hourly resolution on the exact same 2-km horizontal grid as the original WIND Toolkit.

Repackaged from the National Oceanic and Atmospheric Administration's (NOAA) operational High-Resolution Rapid Refresh (HRRR) forecasts, the dataset bridges the critical gap between historical industry baselines and modern operational weather data. Spanning from 2015 to the present with planned annual extensions, it overcomes the technical barriers of native weather models by providing spatial regridding, temporal gap-filling, and vertical interpolation at key energy-relevant heights. By delivering highly accurate, validation-backed data across a comprehensive suite of atmospheric variables -including temperature, pressure, humidity, and wind characteristics - the HRRR MET Toolkit provides a highly accessible and strictly standardized foundation for modern power system modeling.

Tags: 2-km, atmosphere, atmospheric, conus, data, energy, hourly, hrrr, meteorology, nlr, operations, planning, power, processed-data, transmission, wind, wind-energy, wind-power, wind-toolkit
Organization: Department of Energy
Literature Collection for the Evaluation Of Physics-Based Drilling and Alternative Bit Design At The Geysers

This submission contains links to multiple publications on the Evaluation Of Physics-Based Drilling and Alternative Bit Design At The Geysers. The long-term goal of the project was to safely implement oil and gas industry drilling best-practices, particularly with respect to limiter-redesign. These approaches to improving processes have been proven to enable step-change performance compared to incremental performance improvements based on empirical data or conventional wisdom. There were four (4) major objectives to the project: 1) Identify and understand process limiters from historical drilling data, 2) Establish workflow for implementing limiter redesign for upcoming drilling campaigns, 3) Adopt modern bit technology and utilize in upcoming drilling campaign, and 4) Implement advanced control strategies to reach limits based on electronic drilling records (EDR) data analytics.

Tags: bit-design, bit-technology, control-strategies, electronic-drilling-records, energy, geothermal, geysers, limiter-redesign, physics-based-drilling, publications
Organization: Department of Energy
United States Geothermal Heat Pump Installations Database - 2025

This dataset documents U.S. geothermal heat pump (GHP) installations and was compiled as part of the 2025 Geothermal Market Report from the National Renewable Energy Laboratory (NREL). Records were sourced primarily from public drilling permits and include location information (city, county, state, and latitude/longitude), installation dates, and basic system characteristics such as capacity, number and depth of boreholes, and configuration. Data reflect publicly available permit information and capture the distribution and characteristics of GHP systems installed across the United States.

Tags: 2025, borehole, borehole-depth, building-systems, database, drilling-permits, geothermal, geothermal-heat-pump, ghp, ground-source-heat-pump, heat-pumps, heating-and-cooling, installation-database, market-report, number-of-boreholes, processed-data, system-capacity, system-configuration, united-states
Organization: Department of Energy
Cape EGS and Utah FORGE: Empirical 3D Seismic Velocity Model

This dataset provides an empirical three-dimensional P- and S-wave velocity model covering a 30 x 30 km area and extending to 10 km depth around the Cape Modern EGS and Utah FORGE sites. It incorporates three-dimensional topography and a sediment/basement contact derived from geophysical and geological datasets collected by Utah FORGE or Fervo Energy. Basin velocities were estimated from a logarithmic fit to borehole velocity logs, while basement velocities were assigned constant values of 5.8 km/s for Vp and 3.392 km/s for Vs. No geophysical data inversion was performed in constructing this model.

The dataset includes a manuscript describing the methods used to develop the model. The velocity model is provided in NetCDF format. Users will need software capable of reading NetCDF files. Common scientific libraries support this format without requiring proprietary tools. We recommend the Xarray package for Python, where methods like open_dataset() and .sel().plot() can be used to read and plot the data.

Tags: 3d-model, borehole-velocity, cape-egs, cape-modern, egs, empirical-model, energy, enhanced-geothermal-systems, geothermal, netcdf, p-wave, s-wave, seismic, seismic-velocity, subsurface-characterization, utah-forge, velocity, velocity-model
Organization: Department of Energy
Highway-Rail Crossing Incidents - Landing Page

Reports for highway-rail grade crossing incidents can be found within this portal. All impacts between railroad on-track equipment and highway users at a highway-rail grade crossing are reported by railroads to the FRA on Form FRA F 6180.57 Highway-Rail Grade Crossing Accident/Incident Report.

Tags: highway-rail-crossing-incidents, highway-rail-grade-crossing, incidents, road-or-pathway-crosses-one-or-more-railroad-tracks
Organization: Department of Transportation
Surveying establishment success: A capstone survey of <i>Floracarus perrepae</i> and <i>Neomusotima conspurcatalis</i> on <i>Lygodium microphyllum</i>

<p dir="ltr">We started an establishment survey in July of 2023 to understand where the biological control agents have successfully established and/or dispersed. Study sites were chosen throughout <i>Lygodium microphyllum</i>’s invaded range based on iNaturalist and EDDMaps observations. Two surveys were conducted, one for each biological control agent.​ For <i>Floracarus perrepae</i> 5 points were selected at an interval of at least 10 meters. At each point, 3 samples of 2 fully expanded sub pinnae pairs were collected haphazardly. These samples were brought back to the lab, the number of galls were counted, and a subset of 25 galls were dissected to determine how many mites were in each gall. For <i>Neomusotima conspurcatalis</i> two surveyors non-systematically explored the <i>L. microphyllum</i> patch for 15 minutes (for a total of 30 minutes) looking for and inspecting for feeding damage, larvae, and adults.​</p><p dir="ltr">Partially funded by the USDA through the Comprehensive Everglades Restoration Plan (CERP) (USDA agreement 58-6032-1-001) and through the Southwest Florida Water Management District (USDA agreement 58-6032-3-003)</p>

Tags: biological-control, ferns, floracarus-perrepae, invasive-species, lygodium-microphyllum, mites, moths, neomusotima-conspurcatalis, usda
Organization: Department of Agriculture
Anastrepha ludens genome assembly scripts

<p dir="ltr">The data in this repository is to provide the scripts used in the assembly of the <i>Anastrepha ludens </i>genome. It can be used to replicate the steps necessary to assemble the genome described in National Center for Biotechnology Information (NCBI) BioProject: <a href="https://www.ncbi.nlm.nih.gov/bioproject/PRJNA803324/" target="_blank">PRJNA803324</a>. This genome assembly workflow was performed on the United States Department of Agriculture (USDA) - SCINet/Mississippi State University High Performance Computing Cluster (HPC) Atlas and installed via Conda.</p><p><br></p>

Tags: anastrepha-ludens, chromosomes, genome, genome-assembly, genome-assembly-protocol, mexfly, mexican-fruit-fly
Organization: Department of Agriculture
Tracking fluctuations of <i>Neomusotima conspurcatalis</i> populations

<p dir="ltr"><i>Lygodium microphyllum</i> (Lygodiaceae) is an invasive vine that has invaded natural areas in Florida. The USDA-ARS Invasive Plant Research Laboratory mass rears and releases two biological control agents to help manage <i>L. microphyllum</i> infestations, one is the moth <i>Neomusotima conspurcatalis</i> (Lepitoptera: Crambidae). As part of the mass rearing of the biological control agent surveys are completed to monitor agent populations and to quantify their impact on <i>L. microphyllum</i> growth. This dataset contains the results of random search surveys from April 2018 to Sept 2021. In April 2018, permanent transect start points were established for timed searches at four monitoring sites to quantify agent impact. Time searches utilizes two surveyors that non-systematically explored the <i>L. microphyllum</i> patch for 15 minutes (for a total of 30 minutes) looking for and inspecting for feeding damage, larvae, and adults.​ To determine whether biological control agents establish self-perpetuating field populations in addition to the timed searches monthly monitoring of <i>N. conspurcatalis</i> capsule traps that incorporated the pheromones from pupae were deployed. Use of the capsule traps was suspended in March of 2020.</p><p dir="ltr">Partially funded by the USDA through the Comprehensive Everglades Restoration Plan (CERP) (USDA agreement 58-6032-1-001), through the through Southwest Florida Water Management District (USDA agreement 58-6032-3-003), and through the Florida Fish and Wildlife Conservation Commission (USDA agreement 58-6032-9-008).</p>

Tags: biological-control, ferns, invasive-species, moths, neomusotima-conspurcatalis, pheromones, usda
Organization: Department of Agriculture
Bombus huntii genome assembly scripts

<p dir="ltr">The data in this repository is to provide the scripts used in the assembly of the <i>Bombus huntii </i>genome. It can be used to replicate the steps necessary to assemble the genome described in National Center for Biotechnology Information (NCBI) BioProject: <a href="https://www.ncbi.nlm.nih.gov/bioproject/858880" rel="noreferrer" target="_blank">PRJNA858880</a>. This genome assembly workflow was performed on the United States Department of Agriculture (USDA) - SCINet/Mississippi State University High Performance Computing Cluster (HPC) Atlas and installed via Conda.</p><h2>Dependencies</h2><ul><li><a href="https://github.com/pezmaster31/bamtools" target="_blank">bamtools</a> v2.5.1</li><li><a href="https://github.com/madler/pigz" target="_blank">pigz</a> v2.6</li><li><a href="https://github.com/tseemann/any2fasta" target="_blank">any2fasta</a> v0.4.2</li><li><a href="https://docs.sylabs.io/guides/3.0/user-guide/installation.html" rel="nofollow" target="_blank">Singularity</a> v3.8.3</li><li><a href="https://github.com/ncbi/fcs/wiki/FCS-adaptor" target="_blank">NCBI FCS adaptor</a></li><li><a href="https://github.com/sheinasim/HiFiAdapterFilt" target="_blank">HiFiAdapterFilt</a> v3.0.1</li><li><a href="https://github.com/chhylp123/hifiasm" target="_blank">HiFiASM</a> v0.19.3-r572</li><li><a href="https://jgi.doe.gov/data-and-tools/software-tools/bbtools/bb-tools-user-guide/" rel="nofollow" target="_blank">BBmap</a> v38.90</li><li><a href="https://github.com/refresh-bio/KMC" target="_blank">KMC</a> v3.2.1</li><li><a href="https://github.com/tbenavi1/genomescope2.0" target="_blank">GenomeScope2</a> v2.0</li><li><a href="https://blast.ncbi.nlm.nih.gov/doc/blast-help/downloadblastdata.html#downloadblastdata" rel="nofollow" target="_blank">BLAST+</a> v2.0</li><li><a href="https://github.com/bbuchfink/diamond" target="_blank">diamond</a> v2.0.9</li><li><a href="https://github.com/lh3/minimap2" target="_blank">minimap2</a> v2.22-r1101</li><li><a href="https://github.com/blobtoolkit/blobtoolkit" target="_blank">blobtoolkit2</a> v4.1.5</li><li><a href="https://github.com/sheinasim/blobblurb" target="_blank">blobblurb</a> v1.2</li><li><a href="https://github.com/sheinasim/seqer" target="_blank">seqer</a> v1.2</li><li><a href="https://github.com/c-zhou/yahs" rel="noreferrer" target="_blank">yahs</a> v1.1</li></ul><p dir="ltr"><br></p>

Tags: bombus-hunti, genome-assembly, genome-assembly-protocol, genome-chromosomes, hunt-bumble-bee
Organization: Department of Agriculture
In-house annotated gene set for the pecan weevil, <i>Curculio caryae</i>

<p dir="ltr">This in-house annotated gene set was created using the following methods. </p><p dir="ltr">RNA was isolated from the head and thorax segments of one adult male and one adult female pecan weevil using the NucleoMag RNA Kit (Macherey-Nagel, Düren, Germany, 744350.1) according to kit protocols. Isolated RNA was processed into PacBio Kinnex sequencing libraries using the Iso-Seq express 2.0 kit (Pacific Biosciences, Menlo Park, CA, USA 103-071-500) and Kinnex full-length RNA kit (Pacific Biosciences, Menlo Park, CA, USA,103-072-000). The prepared library was bound and sequenced at the USDA-ARS Veterinary Pest Genetics Research Unit in Kerrville, Texas, on two Pacific Biosciences SMRT cell trays with a Revio system (Pacific Biosciences, Menlo Park, CA, USA, 102-202-200) beginning with a 2-h pre-extension followed by a 30-h movie collection time. After sequencing, circular consensus sequences from the PacBio Sequel Revio subreads were obtained using the SMRTLink v13.0 software. Reads were subsequently mapped to the repeat-masked genome assembly using minimap2 with arguments for spliced nucleotide sequences (<i>-ax splice:hq</i>) to generate sam mapping files. These were then compressed into bam files using samtools view -bS and used as input for gene model prediction with the Braker version 3.0.8 program (<a href="https://github.com/Gaius-Augustus/BRAKER" target="_blank">https://github.com/Gaius-Augustus/BRAKER</a>), generating 72,879 gene models. These gene models and amino acid protein predictions were further curated and annotated with gene ontologies and protein domains using InterProScan-5.73-104.0 with PANTHER-19.0 and Pfam-37.2 databases (<a href="https://github.com/ebi-pf-team/interproscan" target="_blank">https://github.com/ebi-pf-team/interproscan</a>), resulting in 19,508 InterProScan results.</p>

Tags: gene-annotation, pecan-weevil
Organization: Department of Agriculture
Code from: Aspergillus flavus expression database (AFED), a comprehensive resource for Aspergillus flavus gene expression profiling

<p dir="ltr">Public RNA-Seq data was used to quantify gene expression abundance for 604 Aspergillus flavus samples from 52 experiments (bioprojects). Using abundance data, we created an Aspergillus flavus expression database (AFED) accessible through a web-based interface that allows for the expression profiles of genes to be conveniently examined across different growth conditions and life cycle stages. Expression profiles can be visualized through either an interactive bar plot for single gene queries or a heatmap for multiple gene queries. A gene co-expression network based on samples containing at least 10 million mapped reads   is also available, which allows users to identify genes that are co-expressed with an individual gene or set of genes and displays the functional enrichment among the co-expressed genes.</p>

Tags: aspergillus-flavus, expression-atlas, expression-database, web-app
Organization: Department of Agriculture
Data from: Genomic analysis of <i>Vanessa tameamea</i>, the threatened Hawaiian endemic butterfly, reveals population genetic structure relevant to conservation efforts

<p dir="ltr">Scripts listed here exemplify those used in the assembly of the <i>Vanessa tameamea</i> genome (Hawaiian Kamehameha butterfly) as found in NCBI BioProjects <a href="https://www.ncbi.nlm.nih.gov/bioproject/PRJNA1029194/" target="_blank">PRJNA1029194</a> (female) and <a href="https://www.ncbi.nlm.nih.gov/bioproject/PRJNA1029239/" rel="noreferrer" target="_blank">PRJNA1029239</a> (male). Reduced representation sequences from double digest Restriction Associated DNA (ddRAD) are included in BioProject <a href="https://www.ncbi.nlm.nih.gov/bioproject/PRJNA428520/" rel="noreferrer" target="_blank">PRJNA428520</a> and were used for population genetic analyses. All workflows and analyses except for the DAPC (Discriminant Analysis of Principal Components), PCA (Principal Component Analysis), and hierarchical Fst were performed on the United States Department of Agriculture (USDA) - SCINet/Mississippi State University High Performance Computing Cluster (HPC) Atlas and were installed via Conda. The remaining scripts were run in R.</p>

Tags: conservation, genome-assembly-projects, genome-assembly-protocol, hawaii-butterfly, population-genetics-model, population-genetics-statistics, vanessa-tameamea
Organization: Department of Agriculture
Genome sequencing of Curculio caryae adult female principal pseudohaplotype

<p dir="ltr">The pecan weevil, <i>Curculio caryae </i>(Horn), is an obligate feeder of pecan and native hickory throughout North America. Subsequently it is a significant agricultural pest in commercial pecan orchards. In this study, we present a reference quality genome using deep-coverage, ~50x PacBio HiFi genome sequence reads, and chromatic confirmation, Hi-C, scaffolding. The final genome assembly is approximately 2.1 Gb, which was confirmed with flow cytometry. The primary genome scaffolds have an N50 of 132 Mb and a BUSCO completeness of 99.1% [S:97.5%, D:1.6%]. Furthermore, we employed PacBio long-read RNA, Iso-seq, for <i>de novo </i>annotation, followed by InterProscan to identify approximately 16,000 protein coding genes. Repeat content is extensive, contributing to >75% of the total genome. This data set provides a valuable resource for use in comparative genomics and evolutionary studies for an economically impactful group of insect pests that currently lack genomic resources.</p>

Tags: ag100pest, curculio-caryae, hifi-genome-assembly, pecan-weevil
Organization: Department of Agriculture