AndreaBozzo/ceres-open-data-index huggingface dataset:
Distributed Data Mining in Peer-to-Peer Networks

Peer-to-peer (P2P) networks are gaining popularity in many applications such as file sharing, e-commerce, and social networking, many of which deal with rich, distributed data sources that can benefit from data mining. P2P networks are, in fact,well-suited to distributed data mining (DDM), which deals with the problem of data analysis in environments with distributed data,computing nodes,and users. This article offers an overview of DDM applications and algorithms for P2P environments,focusing particularly on local algorithms that perform data analysis by using computing primitives with limited communication overhead. The authors describe both exact and approximate local P2P data mining algorithms that work in a decentralized and communication-efficient manner.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
SIAM 2007 Text Mining Competition dataset

**Subject Area:**
    Text Mining

**Description:**
    This is the dataset used for the SIAM 2007 Text Mining competition. This competition focused on developing text mining algorithms for document classification. The documents in question were aviation safety reports that documented one or more problems that occurred during certain flights. The goal was to label the documents with respect to the types of problems that were described. This is a subset of the Aviation Safety Reporting System (ASRS) dataset, which is publicly available.

**How Data Was Acquired:**
    The data for this competition came from human generated reports on incidents that occurred during a flight.

**Sample Rates, Parameter Description, and Format:**
    There is one document per incident. The datasets are in raw text format. All documents for each set will be contained in a single file. Each row in this file corresponds to a single document. The first characters on each line of the file are the document number and a tilde separats the document number from the text itself.

**Anomalies/Faults:**
    This is a document category classification problem.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Improving Multiple Fault Diagnosability using Possible Conflicts

Multiple fault diagnosis is a difficult problem for dynamic systems. Due to fault masking, compensation, and relative time of fault occurrence, multiple faults can manifest in many different ways as observable fault signature sequences. This decreases diagnosability of multiple faults, and therefore leads to a loss in effectiveness of the fault isolation step. We develop a qualitative, event-based, multiple fault isolation framework, and derive several notions of multiple fault diagnosability. We show that using Possible Conflicts, a model decomposition technique that decouples faults from residuals, we can significantly improve the diagnosability of multiple faults compared to an approach using a single global model. We demonstrate these concepts and provide results using a multi-tank system as a case study.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Combining Model-Based and Feature-Driven Diagnosis Approaches – A Case Study on Electromechanical Actuators

Model-based diagnosis typically uses
analytical redundancy to compare predictions from a model against observations from the system being diagnosed. However this approach does not work very well when it is not feasible to create analytic relations describing all the observed data, e.g., for vibration data which is usually sampled at very high rates and requires very detailed finite element models to describe its behavior. In such cases, features (in time and frequency domains) that contain diagnostic information are extracted from the data. Since this is a computationally intensive process, it is not efficient to extract all the features all the time. In this paper we present an approach that combines the analytic model-based and feature-driven diagnosis approaches. The analytic approach is used to reduce the set of possible faults and then features are chosen to best distinguish among the remaining faults. We describe an implementation of this approach on the Flyable Electro-mechanical Actuator (FLEA) test bed.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Suomi-NPP VIIRS Level-3 Global Binned 11µm Nighttime Sea Surface Temperature (NSST) Data, version R2016.2

The Visible and Infrared Imager/Radiometer Suite (VIIRS) is a multi-disciplinary instrument that is being flown on the Joint Polar Satellite System (JPSS) series of spacecraft, including the Suomi National Polar-orbiting Partnership (S-NPP) that launched in October 2011. JPSS is a multi-platform, multi-agency program that consolidates the polar orbiting spacecraft of NASA and the National Oceanic and Atmospheric Administration (NOAA). S-NPP is the initial spacecraft in this series, and VIIRS is the successor to MODIS for Earth science data product generation. VIIRS has 22 spectral bands ranging from 412 nm to 12 nm. There are 16 moderate-resolution bands (750m at nadir), 5 image-resolution bands (375m), and one day-night band (DNB).

Tags: earth-science, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
OCO-2 Level 2 CO2 prior based on CO2 monthly flask record, global meteorology, and age of air V11.2 (OCO2_L2_CO2Prior) at GES DISC

Version 11.2 is the current version of the data set. Older versions will no longer be available and are superseded by Version 11.2.

The Orbiting Carbon Observatory is the first NASA mission designed to collect space-based measurements of atmospheric carbon dioxide with the precision, resolution, and coverage needed to characterize the processes controlling its buildup in the atmosphere. The OCO-2 project uses the LEOStar-2 spacecraft that carries a single instrument. It incorporates three high-resolution spectrometers that make coincident measurements of reflected sunlight in the near-infrared CO2 near 1.61 and 2.06 micrometers and in molecular oxygen (O2) A-Band at 0.76 micrometers.

Tags: atmosphere, atmospheric-chemistry, earth-science
Organization: National Aeronautics and Space Administration
SWOT Level 2 Nadir Altimeter Geophysical Data Record with Waveforms - GDR

The SWOT Level 2 Nadir Altimeter Geophysical Data Record (GDR) with Waveforms dataset produced by the Surface Water and Ocean Topography (SWOT) mission provides sea surface height, significant wave height and wind speed measurements from the Poseidon-3C nadir altimeter, a Jason-class dual frequency (Ku/C) altimeter. SWOT is a joint mission between NASA and CNES that launched on December 16, 2022. It aims to measure ocean surface topography with unprecedented resolution and accuracy, as well as map inland water bodies globally. The GDR dataset consists of discrete measurements for each half orbit along the ground track with sampling resolutions of approximately 6-km and 300-m at 1Hz and 20Hz, respectively. The data were processed using restituted auxiliary data and the Precise Orbit Ephemeris (POE). The data are available with latency of < 90 days and distributed in netCDF-4 file format.
<br>This collection is a sub-collection of its parent: https://podaac.jpl.nasa.gov/dataset/SWOT_L2_NALT_GDR_2.0

Tags: earth-science, ocean-waves, oceans, sea-surface-topography
Organization: National Aeronautics and Space Administration
Supporting Information for Doppler Orbitography and Radiopositioning Integrated by Satellite (DORIS) Data and Products from NASA CDDIS

Doppler Orbitography and Radiopositioning Integrated by Satellite (DORIS) Data (multi-day files) from the NASA Crustal Dynamics Data Information System (CDDIS). DORIS is a dual-frequency Doppler system consisting of a receiver flying aboard a satellite and a globally distributed network of ground beacons. The DORIS receiver on-board the orbiting satellite tracks the dual-frequency radio signals transmitted by the network of ground beacons and generates the DORIS data. A measurement is made of either the Doppler shift or absolute phase as the satellite’s orbit moves over the ground-based beacon. DORIS data records contain a time-tagged range-rate measurement with associated ancillary information. The data records also contain information about any corrections that may have been applied during the processing phase, such as for the ionosphere, troposphere, and satellite center of mass, among others. Furthermore, meteorological measurements (e.g., temperature, relative humidity, ground pressure) recorded by instruments co-located with the ground-based beacons are included with the DORIS data and can be used to determine the tropospheric correction. More information about these data is available on the CDDIS website at https://cddis.nasa.gov/Data_and_Derived_Products/DORIS/DORIS_data_and_product_archive.html.

Tags: earth-science, geodetics, gravity-gravitational-field, solid-earth, tectonics
Organization: National Aeronautics and Space Administration
AMSR-E/Aqua L2B Surface Soil Moisture, Ancillary Parms, & QC EASE-Grids V002

This Level-2B land surface product (AE_Land) includes daily measurements of surface soil moisture, vegetation/roughness water content interpretive information, and quality control variables. Ancillary data include time, geolocation, and quality assessment.

Tags: biosphere, earth-science, land-surface, soils, vegetation
Organization: National Aeronautics and Space Administration
SMAP L3 Radar/Radiometer Global Daily 9 km EASE-Grid Soil Moisture V003

This Level-3 (L3) soil moisture product provides a daily composite of global land surface conditions retrieved by both the Soil Moisture Active Passive (SMAP) radar and radiometer. SMAP L-band soil moisture data are resampled to an Earth-fixed, global, cylindrical 9 km Equal-Area Scalable Earth Grid, Version 2.0 (EASE-Grid 2.0).

Tags: earth-science, land-surface, microwave, radar, soils, spectral-engineering
Organization: National Aeronautics and Space Administration
A Local Scalable Distributed Expectation Maximization Algorithm for Large Peer-to-Peer Networks

This paper describes a local and distributed expectation maximization algorithm for learning parameters of Gaussian mixture models (GMM) in large peer-to-peer (P2P)
environments. The algorithm can be used for a variety of well-known data mining tasks in distributed environments such as clustering, anomaly detection, target tracking, and
density estimation to name a few, necessary for many emerging P2P applications in bioinformatics, webmining and sensor networks. Centralizing all or some of the data to build global models is impractical in such P2P environments because of the large number of data sources, the asynchronous nature of the P2P networks, and dynamic nature of the data/network. The proposed algorithm takes a two-step approach. In the
monitoring phase, the algorithm checks if the model ‘quality’ is acceptable by using an efficient local algorithm. This is then
used as a feedback loop to sample data from the network and rebuild the GMM when it is outdated. We present thorough experimental results to verify our theoretical claims.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
VIIRS/NPP Sea Ice Cover Daily L3 Global 375m EASE-Grid 2.0 Day V002

This data set reports sea ice cover/extent derived from radiance data acquired by the Visible Infrared Imager Radiometer Suite (VIIRS). Following the approach used by MODIS, the algorithm converts VIIRS calibrated radiances into brightness temperature and computes sea ice cover using Normalized Difference Snow Index (NDSI).

VIIRS flies on board the Suomi National Polar-orbiting Partnership (NPP) satellite.

Tags: cryosphere, earth-science, sea-ice
Organization: National Aeronautics and Space Administration
SENTINEL-1A_SINGLE_POL_GRD_MEDIUM_RES

Sentinel-1A Single-pol ground projected medium resolution images

Tags: agriculture, biosphere, coastal-processes, cryosphere, earth-science, erosion-sedimentation, forest-science, frozen-ground, geomorphic-landforms-processes, glaciers-ice-sheets, land-surface, land-use-land-cover, landscape, ocean-waves, ocean-winds, oceans, sea-ice, snow-ice, solid-earth, surface-water, tectonics, terrestrial-ecosystems, terrestrial-hydrosphere, topography
Organization: National Aeronautics and Space Administration
A Comparison of Three Data-driven Techniques for Prognostics

In situations where the cost/benefit analysis of using physics-based damage propagation algorithms is not favorable and when sufficient test data are available that map out the damage space, one can employ data-driven approaches. In this investigation, we evaluate different algorithms for their suitability in those circumstances. We are interested in assessing the trade-off that arises from the ability to support uncertainty management, and the accuracy of the predictions. We compare here a Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), and a Neural Network-based approach and employ them on relatively sparse training sets with very high noise content. Results show that while all methods can provide remaining life estimates although different damage estimates of the data (diagnostic output) changes the outcome considerably. In addition, we found that there is a need for performance metrics that provide a comprehensive and objective assessment of prognostics algorithm performance.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Annotated reference transcriptome for female Culicoides sonorensis biting midges

<p>Unigene sequences were annotated by BlastX alignment to the non-redundant protein database (National Center for Biotechnology Information/GenBank) and the Aedes aegypti and Culex quinquefasciatus gene annotations (Vectorbase). This was done with a 1e-05 expectation value. Top hits are shown including accession numbers and description, if available. Unigene number and corresponding GenBank accession numbers are provided for all C. sonorensis genes. Both tables are modified from supplementary information tables at <a href="http://dx.doi.org/10.1371/journal.pone.0098123.s003">http://dx.doi.org/10.1371/journal.pone.0098123.s003</a> and numbered accordingly.</p>
<div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: table s2 annotation.</p> <p>File Name: table s2 annotation.xlsx</p></li><br><li><p>Resource Title: table S3 GO terms.</p> <p>File Name: table S3 GO terms.xlsx</p></li><br><li><p>Resource Title: data dictionary Nayduch S2 S3.</p> <p>File Name: data dictionary Nayduch S2 S3_2.csv</p><p>Resource Description: Defines parameters for annotation and GO terms.</p></li></ul>

Tags: anautogeny, ars, biting-midge, bluetongue, culicoides-sonorensis, data-gov, de-novo-transcriptome, ehdv, epizootic-hemorrhagic-disease-virus, flies, hematophagy, insects, np104, rnaseq, vector, vitellogenesis
Organization: Department of Agriculture
Isotope-corrected Critical Ratio calculations

<p>This Microsoft Excel workbook (168.259 Mb) calculates Critical Ratios for triacylglycerols based on manually entered mass spectra, with isotope correction by isotope patterns calculated at www.ChemCalc.org. Average mass spectra across integrated peaks are manually entered according to the instructions in the Supplementary Material to the publication 'The Updated Bottom Up Solution for Mass Spectrometry of Soybean Oil in a Dietary Supplement Gelcap". </p><div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: Isotope-corrected Critical Ratio calculations.</p> <p>File Name: Web Page, url: <a href="https://www.ars.usda.gov/research/software/download/?softwareid=458&modecode=80-40-05-05">https://www.ars.usda.gov/research/software/download/?softwareid=458&modecode=80-40-05-05</a> </p><p>download page</p></li></ul><p></p>

Tags: computer-software, dietary-supplements, isotopes, mass-spectrometry, models, soybeal-oil, triacylglycerols
Organization: Department of Agriculture
PIECE: Plant Intron Exon Comparison and Evolution Database

<p>PIECE is a plant gene structure comparison and evolution database with 25 species. Annotated genes extracted from the species are classified based on the Pfam motif and phylogenetic trees are reconstructed for each gene category integrating exon-intron and protein motif information. </p><div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: Web Page.</p> <p>File Name: Web Page, url: <a href="https://probes.pw.usda.gov/piece/index.php">https://probes.pw.usda.gov/piece/index.php</a> </p></li></ul><p></p>

Tags: ars, data-gov, genetics-genomics-breeding, online-database
Organization: Department of Agriculture
IncA-C Alignment

<p>IncA/C plasmids are a class of plasmids from Enterobacteraciae that are relatively large (49 to >180 kbp), are readily transferred by conjugation, and carry multiple antimicrobial resistance genes. Reconstruction of the phylogeny of these plasmids has been difficult because of the high rate of remodeling by recombination-mediated horizontal gene transfer (HGT). We hypothesized that evaluation of nucleotide polymorphisms relative to the rate of HGT would help to develop a clock to show if anthropic practices have had significant influences on the lineages of the plasmid. A system was developed to rapidly sequence up to 191 known open27 reading-frames from each of 39 recently isolated IncA/C plasmids from a diverse panel of Salmonella enterica and Escherichia coli. With these data plus sequences from Genbank we were able to distinguish six distinct lineages that had extremely low numbers of polymorphisms within each lineage, especially among the largest group designated as Lineage 1. Two regions, each about half the plasmid in size, could be distinguished with a separate lineal pattern. The distribution of Lineage 1 showed that it has migrated extremely rapidly with fewer polymorphisms than can be expected in two-thousand years. Remodeling by frequent HGT was evident with a pattern that appeared to have the highest rate just upstream of the putative conjugation origin of transfer (ori-T). It seems likely that when an IncA/C plasmid is transferred also adjacent to a multiple antimicrobial resistance gene cassette. </p>
<div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: Website pointer to Inc A/C Sequence Data.</p> <p>File Name: Web Page, url: <a href="https://www.ars.usda.gov/southeast-area/athens-ga/us-national-poultry-research-center/bacterial-epidemiology-antimicrobial-resistance-research/docs/inc-ac-sequence-data/" target="_blank">https://www.ars.usda.gov/southeast-area/athens-ga/us-national-poultry-research-center/bacterial-epidemiology-antimicrobial-resistance-research/docs/inc-ac-sequence-data/</a> </p><p>Inc A/C Alignment - FastA format, Inc A/C Alignment - Geneious format (compatible with versions 6.1 and later), Supplemental Table</p></li></ul>

Tags: ars, data-gov, np108
Organization: Department of Agriculture
Updated Bottom Up Solution for Triacylglycerols

<p>This Microsoft Excel workbook (2.712 Mb) contains spreadsheets that implement the Updated Bottom Up Solution for Triacylglycerols that allows Critical Ratios that provide structural information from mass spectrometry to be used to reconstitute the original mass spectra from which they came. It contains spreadsheets that use the non-nested equations (Critical Limits explicitly shown), as well as spreadsheets that used the nested equations (Case determinations made with Critical Limits not explicitly shown). </p><div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: Updated Bottom Up Solution for Triacylglycerols.</p> <p>File Name: Web Page, url: <a href="https://www.ars.usda.gov/research/software/download/?softwareid=459&modecode=80-40-05-05">https://www.ars.usda.gov/research/software/download/?softwareid=459&modecode=80-40-05-05</a> </p><p>download page</p></li></ul><p></p>

Tags: computer-software, equations, mass-spectrometry, models, triacylglycerols
Organization: Department of Agriculture
GENOSIM

<p>The genosim package simulates genotypes, breeding values, and phenotypes; simulates DNA sequence read depth (numbers of A and B alleles); and resolves SNP conflicts between parent and offspring genotypes. </p><div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: GENOSIM.</p> <p>File Name: Web Page, url: <a href="https://www.ars.usda.gov/research/software/download/?softwareid=496&modecode=80-42-05-30">https://www.ars.usda.gov/research/software/download/?softwareid=496&modecode=80-42-05-30</a> </p><p>download page</p></li></ul><p></p>

Tags: breeding-value, computer-software, models, nucleotide-sequences, phenotype, progeny, single-nucleotide-polymorphism
Organization: Department of Agriculture
Zip Search Version 0.9

<p>Java Tool to extrapolate latitude and longitude from US Postal Service database</p>
<p>The purpose of this tool is to estimate latitude and longitude from a user inputted zip code. This tool has been useful in collecting latitude and longitude data for users within the US that may not have known their corresponding latitude and longitude information.</p>
<p>User Input :</p>
<p>The sole input from the user is the zip code. The program searches the database and then displays the corresponding geographical latitude and longitude. This model was developed as an aid to gather latitude and longitude data from user of our other software tools.</p>
<p>This model was developed in JAVA, is simple to use, and runs on multiple platforms (e.g. Mac, PC, Sun). </p><div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: Zip Search Version 0.9.</p> <p>File Name: Web Page, url: <a href="https://www.ars.usda.gov/research/software/download/?softwareid=156&modecode=50-60-05-00">https://www.ars.usda.gov/research/software/download/?softwareid=156&modecode=50-60-05-00</a> </p><p>download page</p></li></ul><p></p>

Tags: ars, data-gov, latitude-longitude, np305, software-tool
Organization: Department of Agriculture
Deformed wing virus genome sequence data

<p>The presence and replication of honeybee deformed wing virus variant A (DWV-A) was recently confirmed in the red imported fire ants, <em>Solenopsis invicta</em> Buren. Reported here is the complete genome sequence data of this virus from <em>S. invicta</em>, which is valuable for future research on the DWV.</p>

Tags: deformed-wing-virus
Organization: Department of Agriculture
OTUshuff

<p>OTUshuff is a set of tools written in Perl to identify and correct for the presence of pseudo-diversity in contrasts between microbial communities. The variably weighted Odum dissimilarity (DwOdum) allows for down-weighting the influence of either abundant or rare taxa in calculating a measure of similarity between two communities. We show that down-weighting the influence of rare taxa can be used to minimize pseudo b-diversity arising from incomplete sampling. Down-weighting the influence of abundant taxa can increase the sensitivity of hypothesis testing. OTUshuff is an associated test for identifying the presence of pseudo-diversity in pairwise community contrasts. </p><div><br>Resources in this dataset:</div><br><ul><li><p>Resource Title: OTUshuff.</p> <p>File Name: Web Page, url: <a href="https://www.ars.usda.gov/research/software/download/?softwareid=462&modecode=30-12-30-15">https://www.ars.usda.gov/research/software/download/?softwareid=462&modecode=30-12-30-15</a> </p><p>download page</p></li></ul><p></p>

Tags: computer-software, organisms, species-diversity
Organization: Department of Agriculture