AndreaBozzo/ceres-open-data-index huggingface dataset:
Waveform Catalog, Extreme Mass Ratio Binary (Capture)

Numerically-generated  gravitational waveforms for circular inspiral into Kerr black holes. These waveforms were developed using Scott Hughes' black hole perturbation theory code (the 'Teukolsky code').

Tags: astronomy, binary, black-hole, gravitational-waves, ligo, neutron-stars, space-science
Organization: National Aeronautics and Space Administration
SWOT Level 2 Nadir Altimeter Operational Geophysical Data Record with Waveforms - GDR, Version 2.0

Same as L2_NALT_GDR using predicted values for some auxiliary data, and does not have GIM ionosphere model values. Uses the onboard DORIS orbit ephemeris. Available with latency of < 7 hours. Discrete measurements at nadir for each data downlink, along the ground track. Available in netCDF-4 file format.

Tags: earth-science, ocean-waves, oceans, sea-surface-topography
Organization: National Aeronautics and Space Administration
An Adaptive Recurrent Neural Network for Remaining Useful Life Prediction of Lithium-ion Batteries

Prognostics is an emerging science of predicting the health condition of a system (or its components) based upon current and previous system states. A reliable predictor is very useful to a wide array of industries to predict the future states of the system such that the maintenance service could be scheduled in advance when needed. In this paper, an adaptive recurrent neural network (ARNN) is proposed for system dynamic state forecasting. The developed ARNN is constructed based on the adaptive/recurrent neural network architecture and the network weights are adaptively optimized using the recursive Levenberg-Marquardt (RLM) method. The effectiveness of the proposed ARNN is demonstrated via an application in remaining useful life prediction of lithium-ion batteries.*

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Analysis of Virtual Sensors for Predicting Aircraft Fuel Consumption

Previous research described the use of machine learning algorithms to predict aircraft fuel consumption. This technique, known as Virtual Sensors, models fuel consumption as a function of aircraft Flight Operations Quality Assurance (FOQA) data. FOQA data consist of a large number of measurements that are already recorded by many commercial airlines. The predictive model is used for anomaly detection in the fuel consumption history by noting when measured fuel consumption exceeds an expected value. This exceedance may indicate overconsumption of fuel, the source of which may be identified and corrected by the aircraft operator. This would reduce both fuel emissions and operational costs. This paper gives a brief overview of the modeling approach and describes efforts to validate and analyze the initial results of this project. We examine the typical error in modeling, and compare modeling accuracy against both complex and  simplistic regression approaches. We also estimate a ranking of the importance of each FOQA variable used as input, and demonstrate that FOQA variables can reliably be used to identify different modes of fuel consumption, which may be useful in future work. Analysis indicates that fuel consumption is accurately predicted while remaining theoretically sensitive to sub-nominal pilot inputs and maintenance-related issues.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Description, Classification and Inventory of 113 Apollo 17 Rake Samples from Station 1A, 2, 7 and 8

Description, Classification and Inventory of 113 Apollo 17 Rake Samples from Station 1A, 2, 7 and 8; K. Keil, E. Dowty, M. Prinze

Tags: apollo, catalog, lunar, sample
Organization: National Aeronautics and Space Administration
TRMM Ground Validation Radar Site 3D Rain Map L3 1 month 2 km V7 (TRMM_3A55) at GES DISC

The 3A55, 'Monthly 3-D Structure', provides radar site monthly 3-D structure information obtained from 2A55. 
The 2A55 'Radar Site 3-D Reflectivities', is composed of 3 different fields. The first field has an array of 3-D reflectivities in Cartesian coordinates with a 2 km horizontal resolution over an area of 300 km x 300 km for single radar sites, and 724 km x 568 km for Texas multiple radar site, 512 km x 704 km for Florida multiple radar site. It has a vertical resolution of 1.5km and a height range up to 19.5 km. The second field has an array of vertical profiles based on the first field, and the third field has an array of the Contoured Frequency by Altitude Diagram (CFAD) data based on the first and second field.

A key component of the TRMM project is the Ground Validation (GV) effort which consists of collecting data from ground-based radar, rain gauges and disdrometers. The data is quality-controlled, and then validation products are produced for comparison with TRMM satellite products.

The four primary GV sites are:

+ Darwin, Australia; 
+ Houston, Texas; 
+ Kwajalein, Republic of the Marshall Islands;
+ Melbourne, Florida. 

A significant effort is also being supported at NASA Wallops Flight Facility (WFF) and vicinity to provide high quality, long-term measurements of rain rates (via a network of rain gauges collocated with National Weather Service gauges), as well as drop size distributions (DSD) using a variety of instruments, including impact-type Joss Waldvogel, laser-optical Parsivel, as well as two-dimensional video disdrometers.  DSD measurements are also being collected at Melbourne and Kwajalein using Joss-Waldvogel disdrometers.

Tags: atmosphere, earth-science, precipitation, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
NOAA-20 VIIRS Level-3 Global Mapped Triple-window Sea Surface Temperature (SST3) - Near Real-time (NRT) Data, version R2024.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: earth-science, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
SBU Parsivel IMPACTS V1

The SBU Parsivel IMPACTS dataset consists of precipitation data collected by the Parsivel disdrometer in support of the Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) field campaign. IMPACTS was a three-year sequence of winter season deployments conducted to study snowstorms over the U.S Atlantic Coast (2020-2022). The campaign aimed to (1) Provide observations critical to understanding the mechanisms of snowband formation, organization, and evolution; (2) Examine how the microphysical characteristics and likely growth mechanisms of snow particles vary across snowbands; and (3) Improve snowfall remote sensing interpretation and modeling to significantly advance prediction capabilities. The Parsivel disdrometer data include particle size distribution, fall speed, radar reflectivity and precipitation rate. The dataset files are available in netCDF-3 format from January 1 through February 27, 2020.

Tags: atmosphere, clouds, earth-science, precipitation, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
JERS-1_LEVEL1

JERS-1 Level 1 Data

Tags: agriculture, biosphere, earth-science, erosion-sedimentation, forest-science, geomorphic-landforms-processes, land-surface, land-use-land-cover, landscape, solid-earth, surface-water, tectonics, terrestrial-ecosystems, terrestrial-hydrosphere, topography
Organization: National Aeronautics and Space Administration
SIRS/Nimbus-3 Level 1 Radiance Data V001 (SIRSN3L1) at GES DISC

SIRSN3L1 is the Nimbus-3 Satellite Infrared Spectrometer (SIRS) Level 1 Radiance Data product. SIRS measured infrared radiation (11 to 36 micrometers) emitted from the earth and its atmosphere in 13 selected spectral intervals in the carbon dioxide and water vapor bands plus one channel in the 11-micrometer atmospheric window. The radiances were used to determine the vertical temperature and water vapor profiles of the atmosphere. The data were recovered from the original 6250 tapes, and are now stored online as daily files in their original proprietary binary format each with about 14 orbits per day.

The Nimbus-3 SIRS only viewed the nadir of the subsatellite track. Spatial coverage is near global from about latitude -80 to +80 degrees. The data are available from 08 April 1970 (day of year 98) to 08 April 1971. The principal investigator for the SIRS experiment was Dr. David Q. Wark from the NOAA National Environmental Satellite Data and Information Service.

This product was previously available from the NSSDC with the identifier ESAD-00130 (old ID 70-025A-04A).

Tags: earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
IceBridge Ku-Band Radar L1B Geolocated Radar Echo Strength Profiles V002

This data set contains elevation and surface measurements over Greenland, the Arctic, and Antarctica, as well as flight path charts and echogram images acquired using the Center for Remote Sensing of Ice Sheets (CReSIS) Ku-Band Radar Altimeter.

Tags: cryosphere, earth-science, oceans, radar, sea-ice, spectral-engineering
Organization: National Aeronautics and Space Administration
Comparison of Prognostic Algorithms for Estimating Remaining Useful Life of Batteries

We were interested here in particular in conditions where un-modeled effects are present as manifested by the different degradation curve at 45°C. Although all algorithms were given the same amount of information to the degree practical, there were considerable differences in performance. Specifically, the combined Bayesian regression-estimation approach implemented as a RVM-PF framework has significant advantages over conventional methods of RUL estimation like ARIMA and EKF. ARIMA, being a purely data-driven method, does not incorporate any physics of the process into the computation, and hence ends up with wide uncertainty margins that make it unsuitable for long-term predictions. Additionally, it may not be possible to eliminate all non-stationarity from a dataset even after repeated differencing, thus adding to prediction inaccuracy. EKF, though robust against non-stationarity, suffers from the inability to accommodate un-modeled effects and can diverge quickly as shown. We did not explore other variations of the Kalman Filter that might provide better performance such as the unscented Kalman Filter. The Bayesian statistical approach, on the other hand, appears to be well suited to handle various sources of uncertainties since it defines probability distributions over both parameters and variables and integrates out the nuisance terms. Also, it does not simply provide a mean estimate of the time-to-failure; rather it generates a probability distribution over time that best encapsulates the uncertainties inherent in the system model and measurements and in the core concept of failure prediction.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
GPM GROUND VALIDATION ENVIRONMENT CANADA (EC) MICRO RAIN RADAR (MRR) GCPEX V2

The GPM Ground Validation Environment Canada (EC) Micro Rain Radar (MRR) GCPEx V2 dataset was collected from the Micro Rain Radar (MRR) during the GPM Cold-season Precipitation Experiment (GCPEx) in Ontario, Canada during the winter season 2012. GCPEx addressed shortcomings in the GPM snowfall retrieval algorithm by collecting microphysical properties, associated remote sensing observations, and coordinated model simulations of precipitating snow. Operating at 24 GHz the MRR, a vertically pointing Doppler radar, retrieved quantitative rain rates, drop size distributions, radar reflectivity, and fall velocities on vertical profiles up to several kilometers above the unit. The MRR used during GCPEX is the second generation of the instrument manufactured by METEK (URL: http://metek.de/product/mrr-2/). Version 2 of this dataset became active on April 30, 2015.

Tags: atmosphere, earth-science, precipitation, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
TRMM Microwave Imager Hydrometeor Profile L2 1.5 hours V7 (TRMM_2A12) at GES DISC

The new version of these data is in GPM-like format and can be found under the name GPM_2AGPROFTRMMTMI_CLIM.

This dataset, 2A12, ”TMI Profiling”, generates surface rainfall and vertical hydrometeor profiles on a pixel by pixel basis from the TRMM Microwave Imager (TMI) brightness temperature data using the Goddard Profiling algorithm GPROF2010. Because the vertical information comes from a radiometer, it is not written out in independent vertical layers like the TRMM Precipitation Radar. Instead, the output is referenced to one of 100 typical structures for each hydrometeor or heating profile. These vertical structures are referenced as clusters in the output structure. Vertical hydrometeor profiles can be reconstructed to 28 layers by knowing the cluster number (i.e. shape) of the profile and a scale factor that is written for each pixel.

This product contains hydrometeor profiles of cloud liquid water, precipitation water, cloud ice water, precipitation ice, rainfall type, and latent heating in 28 atmospheric layers. 

Changes in horizontal resolution resulting from the TRMM boost that occurred on 24 August 2001:

Pre-Boost (before 7 August 2001): Temporal Resolution: 91.5 min/orbit ~ 16 orbits/day; Swath Width: 760 km; Horizontal Resolution: 4.4 km 

Post-Boost (after 24 August 2001): Temporal Resolution: 92.5 min/orbit ~ 16 orbits/day; Swath Width: 878 km; Horizontal Resolution: 5.1 km

Tags: atmosphere, atmospheric-radiation, atmospheric-water-vapor, clouds, earth-science, precipitation
Organization: National Aeronautics and Space Administration
Peer-to-Peer Data Mining, Privacy Issues, and Games

Peer-to-Peer (P2P) networks are gaining increasing popularity in many distributed applications such as file-sharing, network storage, web caching, sear- ching and indexing of relevant documents and P2P network-threat analysis. Many of these applications require scalable analysis of data over a P2P network. This paper starts by offering a brief overview of distributed data mining applications and algorithms for P2P environments. Next it discusses some of the privacy concerns with P2P data mining and points out the problems of existing privacy-preserving multi-party data mining techniques. It further points out that most of the nice assumptions of these existing privacy preserving techniques fall apart in real-life applications of privacy-preserving distributed data mining (PPDM). The paper offers a more realistic formulation of the PPDM problem as a multi-party game and points out some recent results.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
GPM GROUND VALIDATION NASA S-BAND DUAL POLARIMETRIC (NPOL) DOPPLER RADAR IFLOODS V2

The GPM Ground Validation NASA S-Band Dual Polarimetric (NPOL) Doppler Radar IFloodS dataset was collected from April 30 to June 16, 2013 near Traer, Iowa as part of the Global Precipitation Measurement (GPM) mission Iowa Flood Studies (IFloodS) campaign. Officially the IFloodS campaign ran from May 1 to June 15 but the NPOL Doppler radar was installed and calibrated prior to the start, allowing for the wider period of record. The NPOL radar, developed by a research team from Wallops Flight Facility, is a fully transportable and self-contained S-band (10 cm), scanning dual-polarimetric, doppler research radar that collected and operated nearly continuously during the IFloodS field campaign. It takes accurate volumetric measurements of precipitation including rainfall rate, particle size distributions, water content and precipitation type. The NPOL Doppler Radar IFloodS data is available in Universal Format (UF) with browse images available in PNG file format.

Tags: atmosphere, clouds, earth-science, precipitation, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
CERES Bidirectional Scans JPSS-1 FM6 Edition1-CV

CER_BDS_J01-FM6_Edition1-CV is the Clouds and the Earth's Radiant Energy System (CERES) Bidirectional Scans (BDS) Joint Polar Satellite System 1 (NOAA-20) Flight Model 6 (FM6) Edition1-CV data product. Data collection for this product is ongoing. 

Note: Edition1-CV data are for instrument validation purposes only and not suited for science publications.

CER_BDS_J01-FM6_Edition1-CV is CERES geolocated and calibrated Top-of-Atmosphere (TOA) filtered radiances and other instrument data. Edition1-CV data are for instrument validation purposes only and not suited for science publications. Each CERES BDS data product contains twenty-four hours of Level-1b data for each CERES scanner instrument mounted on each spacecraft. The BDS includes samples taken in normal and short Earth scan elevation profiles in both fixed and rotating azimuth scan modes (including space, internal calibration, and solar calibration views). The BDS contains Level-0 raw (unconverted) science and instrument data as well as the geolocated converted science and instrument data. The BDS contains additional data not found in the Level-0 input file, including converted satellite position and velocity data, celestial data, converted digital status data, and parameters used in the radiance count conversion equations. 

CERES is a key component of the Earth Observing System (EOS) program. The CERES instruments provide radiometric measurements of the Earth's atmosphere from three broadband channels. The CERES missions are a follow-on to the successful Earth Radiation Budget Experiment (ERBE) mission. The first CERES instrument, protoflight model (PFM), was launched on November 27, 1997 as part of the Tropical Rainfall Measuring Mission (TRMM). Two CERES instruments (FM1 and FM2) were launched into polar orbit on board the Earth Observing System (EOS) flagship Terra on December 18, 1999. Two additional CERES instruments (FM3 and FM4) were launched on board Earth Observing System (EOS) Aqua on May 4, 2002. The CERES FM5 instrument was launched on board the Suomi National Polar-orbiting Partnership (NPP) satellite on October 28, 2011. The newest CERES instrument (FM6) was launched on board the Joint Polar-Orbiting Satellite System 1 (JPSS-1) satellite, now called NOAA-20, on November 18, 2017.

Tags: atmosphere, atmospheric-radiation, earth-science, infrared-wavelengths, sensor-characteristics, spectral-engineering, visible-wavelengths
Organization: National Aeronautics and Space Administration
Metrics for Evaluating Performance of Prognostic Techniques

Prognostics is an emerging concept in condition basedmaintenance(CBM)ofcriticalsystems.Alongwith developing the fundamentals of being able to confidently predict Remaining Useful Life (RUL), the technology calls for fielded applications as it inches towards maturation. This requires a stringent performance evaluation so that the significance of the concept can be fully exploited. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few issues. Instead, the research community has used a variety of metrics based largely on convenience with respect to their respective requirements. Very little attention has been focused on establishing a common ground to compare different efforts. This paper surveys the metrics that are already used for prognostics in a variety of domains including medicine, nuclear, automotive, aerospace, and electronics. It also considers other domains that involve prediction-related tasks, such as weather and finance. Differences and similarities between these domains and health maintenancehave been analyzed to help understand what performance evaluation methods may or may not be borrowed. Further, these metrics have been categorized in several ways that may be useful in deciding upon a suitable subset for a specific application. Some important prognostic concepts have been defined using a notational framework that enables interpretation of different metrics coherently. Last, but not the least, a list of metrics has been suggested to assess critical aspects of RUL predictions before they are fielded in real applications.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
CDDIS_GNSS_products_clocks_realtime

Satellite and receiver clock products derived from analysis of Global Navigation Satellite System (GNSS) data. These products are the generated by analysis centers in support of the International GNSS Service (IGS) and combined by the IGS analysis coordinator to form the official IGS real-time clock product (daily). This product is used for comparison purposes.

Tags: nasa
Organization: National Aeronautics and Space Administration
Towards Requirements in Systems Engineering for Aerospace IVHM Design

Health management (HM) technologies have been employed for safety critical system for decades, but a coherent systematic process to integrate HM into the system design is not yet clear. Consequently, in most cases, health management resorts to be an after-thought or ‘band-aid’ solution. Moreover, limited guidance exists for carrying out systems engineering (SE) on the subject of writing requirements for designs with integrated vehicle health management (IVHM). It is well accepted that requirements are key to developing a successful IVHM system right from the concept stage to development, verification, utilization, and support. However, writing requirements for systems with IVHM capability have unique challenges that require the designers to look beyond their own domains and consider the constraints and specifications of other interlinked systems. In this paper we look at various stages in the SE process and identify activities specific to IVHM design and development. More importantly, several relevant questions are posed that system engineers must address at various design and development stages. Addressing these questions should provide some guidance to systems engineers towards writing IVHM related requirements to ensure that appropriate IVHM functions are built into the system design

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Empirical Evaluation of Diagnostic Algorithm Performance Using a Generic Framework

A variety of rule-based, model-based and datadriven
techniques have been proposed for detection
and isolation of faults in physical systems.
However, there have been few efforts to comparatively
analyze the performance of these approaches
on the same system under identical conditions.
One reason for this was the lack of a standard
framework to perform this comparison. In this paper
we introduce a framework, called DXF, that
provides a common language to represent the system
description, sensor data and the fault diagnosis
results; a run-time architecture to execute
the diagnosis algorithms under identical conditions
and collect the diagnosis results; and an evaluation
component that can compute performance
metrics from the diagnosis results to compare the
algorithms. We have used DXF to perform an empirical
evaluation of 13 diagnostic algorithms on a
hardware testbed (ADAPT) at NASA Ames Research
Center and on a set of synthetic circuits
typically used as benchmarks in the model-based
diagnosis community. Based on these empirical
data we analyze the performance of each algorithm
and suggest directions for future development.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration