AndreaBozzo/ceres-open-data-index huggingface dataset:
Data Mining in Systems Health Management

This chapter presents theoretical and practical aspects associated to the implementation of a combined model-based/data-driven approach for failure prognostics based on particle filtering algorithms, in which the current esti- mate of the state PDF is used to determine the operating condition of the system and predict the progression of a fault indicator, given a dynamic state model and a set of process measurements. In this approach, the task of es- timating the current value of the fault indicator, as well as other important changing parameters in the environment, involves two basic steps: the predic- tion step, based on the process model, and an update step, which incorporates the new measurement into the a priori state estimate.
This framework allows to estimate of the probability of failure at future time instants (RUL PDF) in real-time, providing information about time-to- failure (TTF) expectations, statistical confidence intervals, long-term predic- tions; using for this purpose empirical knowledge about critical conditions for the system (also referred to as the hazard zones). This information is of paramount significance for the improvement of the system reliability and cost-effective operation of critical assets, as it has been shown in a case study where feedback correction strategies (based on uncertainty measures) have been implemented to lengthen the RUL of a rotorcraft transmission system with propagating fatigue cracks on a critical component. Although the feed- back loop is implemented using simple linear relationships, it is helpful to provide a quick insight into the manner that the system reacts to changes on its input signals, in terms of its predicted RUL. The method is able to manage non-Gaussian pdf’s since it includes concepts such as nonlinear state estimation and confidence intervals in its formulation.
Real data from a fault seeded test showed that the proposed framework was able to anticipate modifications on the system input to lengthen its RUL. Results of this test indicate that the method was able to successfully suggest the correction that the system required. In this sense, future work will be focused on the development and testing of similar strategies using different input-output uncertainty metrics.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
TROPICS03 L2B Deep Multispectral INtensity (DMIN) of Tropical cyclones estimator Algorithm V1.0

The "Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats" (TROPICS) mission has a goal of providing nearly all-weather observations of three-dimensional temperature and humidity, as well as cloud ice and precipitation horizontal structure, at high temporal resolution to conduct high-value science investigations of tropical cyclones. The mission comprises a constellation of five identical Space Vehicles (SVs) conforming to the 3U form factor and hosting a passive microwave spectrometer payload.

Each SV hosts an identical high-performance spectrometer named the TROPICS Millimeter-wave Sounder (TMS) that will provide temperature profiles using seven channels near the 118.75-GHz oxygen absorption line, water vapor profiles using three channels near the 183-GHz water vapor absorption line, imagery in a single channel near 90 GHz for precipitation measurements (when combined with higher resolution water vapor channels), and a single channel near 205 GHz that is more sensitive to cloud-sized ice particles.

The Deep Multispectral INtensity of TCs estimator with 183 GHz brightness temperatures (D-MINT183), developed at the University of Wisconsin/CIMSS, estimates two primary TC variables: Minimum Sea Level Pressure (MSLP) and Maximum Sustained Winds (MSW). D-MINT183 is a convolutional neural network (CNN) with no inherent physical understanding of TC intensity relationships, which is an approach that differs from the other two TROPICS TC Intensity algorithm (i.e., TCIE and HISA). D-MINT183 is trained using combinations of 183±1 and 183±3 GHz imagery from SSMIS, ATMS, MHS, and AMSU-B, as well as 15 hours of infrared imagery (in 3-h increments) and scalar predictors. TROPICS has 184.41 GHz and 186.51 GHz imagery, which is used as a proxy for the 183±1 GHz and 183±3 GHz imagery. D-MINT183 produces a probabilistic distribution of intensities for a given TC for 15 different quantiles. The D-MINT183 single-value intensity is the average of the 30th to 70th quantiles, as that was found to be more accurate than the 50th quantile.

Tags: atmosphere, earth-science, weather-events
Organization: National Aeronautics and Space Administration
SMAP_L1C_SIGMA_NAUGHT_HIGH_RES_QA_V002

SMAP Level 1C Sigma Naught High Res Data Quality Info Version 2

Tags: active-remote-sensing, earth-observation-satellites, earth-remote-sensing-instruments, earth-science, imaging-radars, nasa-decadal-survey, platform-characteristics, radar, smap, spectral-engineering
Organization: National Aeronautics and Space Administration
AIRS/Aqua L1B Near Real Time (NRT) AMSU (A1/A2) geolocated and calibrated brightness temperatures V005 (AIRABRAD_NRT) at GES DISC

The AMSU-A Level 1B Near Real Time (NRT) product (AIRABRAD_NRT_005) differs from the routine product (AIRABRAD_005) in 2 ways to meet the three hour latency requirements of the Land Atmosphere NRT Capability Earth Observing System (LANCE): (1) The NRT granules are produced without previous or subsequent granules if those granules are not available within 5 minutes, (2) the predictive ephemeris/attitude data are used rather than the definitive ephemeris/attitude. The consequences of these differences are described in the AIRS Near Real Time (NRT) data products document. The Atmospheric Infrared Sounder (AIRS) is a grating spectrometer (R = 1200) aboard the second Earth Observing System (EOS) polar-orbiting platform, EOS Aqua. In combination with the Advanced Microwave Sounding Unit (AMSU) and the Humidity Sounder for Brazil (HSB), AIRS constitutes an innovative atmospheric sounding group of visible, infrared, and microwave sensors. The AMSU-A instrument is co-aligned with AIRS so that successive blocks of 3 x 3 AIRS footprints are contained within one AMSU-A footprint. AMSU-A is primarily a temperature sounder that provides atmospheric information in the presence of clouds, which can be used to correct the AIRS infrared measurements for the effects of clouds. This is possible because non-precipitating clouds are for the most part transparent to microwave radiation, in contrast to visible and infrared radiation which are strongly scattered and absorbed by clouds. AMSU-A1 has 13 channels from 50 - 90 GHz and AMSU-A2 has 2 channels from 23 - 32 GHz. The AIRABRAD_NRT_005 products are stored in files (often referred to as "granules") that contain 6 minutes of data, 30 footprints across track by 45 lines along track.

Tags: earth-science, microwave, spectral-engineering
Organization: National Aeronautics and Space Administration
GPM Ground Validation NCAR Particle Probes OLYMPEX V1

The GPM Ground Validation NCAR Particle Probes OLYMPEX dataset consists of ice water content, particle concentration normalized by bin width, and total particle concentration collected from three instruments flown on the University of North Dakota (UND) Citation aircraft  during selected dates in November and December 2015.  The PMS Two-Dimensional Cloud probe (2D-C), the SPEC Two-dimensional Stereo probe (2D-S), and two SPEC High Volume Precipitation Spectrometer 3 (HVPS-3) instruments were used in the Global Precipitation Mission (GPM) Olympic Mountains Experiment (OLYMPEX) campaign. All instruments are two-dimensional optical array probes which record images of particles that travel through the sampling area. Data files are available in ASCII format, and browse images are available in PNG format.

Tags: atmosphere, clouds, earth-science
Organization: National Aeronautics and Space Administration
Metrics for Evaluating Performance of Prognostics Techniques

Prognostics is an emerging concept in condition based maintenance (CBM) of critical systems. Along with developing the fundamentals of being able to confidently predict Remaining Useful Life (RUL), the technology calls for fielded applications as it inches towards maturation. This requires a stringent performance evaluation so that the significance of the concept can be fully exploited. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few issues. Instead, the research community has used a variety of metrics based largely on convenience with respect to their respective requirements. Very little attention has been focused on establishing a common ground to compare different efforts. This paper surveys the metrics that are already used for prognostics in a variety of domains including medicine, nuclear, automotive, aerospace, and electronics. It also considers other domains that involve prediction-related tasks, such as weather and finance.  Differences and similarities between these domains and health maintenance have been analyzed to help understand what performance evaluation methods may or may not be borrowed. Further, these metrics have been categorized in several ways that may be useful in deciding upon a suitable subset for a
specific application. Some important prognostic concepts have been defined using a notational framework that enables interpretation of different metrics coherently. Last, but not the 
least, a list of metrics has been suggested to assess critical aspects of RUL predictions before they are fielded in real applications.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
OCO-3 Level 2 spatially ordered geolocated retrievals screened using the A-band Preprocessor, Forward Processing V11 (OCO3_L2_ABand) at GES DISC

Version 11 is the current version of the data set. Older versions will no longer be available and are superseded by Version 11.

The Orbiting Carbon Observatory -3 (OCO-3) was deployed to the International Space Station in May, 2019. It is technically a single instrument, almost identical to OCO-2.

The Orbiting Carbon Observatory is the first NASA mission designed to collect space-based measurements of atmospheric carbon dioxide with the precision, resolution, and coverage needed to characterize the processes controlling its buildup in the atmosphere.

OCO-3 incorporates three high-resolution spectrometers that make coincident measurements of reflected sunlight in the near-infrared CO2 near 1.61 and 2.06 micrometers and in molecular oxygen (O2) A-Band at 0.76 micrometers. The three spectrometers have different characteristics and are calibrated independently. 

Oxygen-A Band cloud screening algorithm is one of the primary cloud screening tools implemented in the operational OCO processing pipeline. The algorithm was introduced and applied to early GOSAT data  with further analysis performed on OCO-2 simulations.

The OCO ABO2 algorithm employs a fast Bayesian retrieval to estimate surface pressure and surface albedo from high resolution spectra of the molecular oxygen (O2) A-band, near 0.765 µm. The radiative transfer forward model (FM) assumes a clear-sky condition, i.e. Rayleigh scattering only, such that differences between the modeled and measured radiances are apparent when the measurement scene contains cloud or aerosol.

Tags: atmosphere, atmospheric-chemistry, earth-science
Organization: National Aeronautics and Space Administration
GIBS Web Map Tile Service (WMTS)

The WMTS implementation standard provides a standards-based solution for serviing digital maps using predefined image tiles.  Through the constructs of the specification, a WMTS service advertises imagery layers (e.g. imagery product) and defines the coordinate reference system, scale, and tiling grid available for access.

Tags: digital, imagery, maps, scale, tiles, wmts
Organization: National Aeronautics and Space Administration
LAMBDA - Legacy Archive for Microwave Background Data Analysis

The High Energy Astrophysics Science Archive Research Center (HEASARC) and the Legacy Archive for Microwave Background Data Analysis (LAMBDA) have merged into a single organization that will use the name HEASARC. The merged archive will continue to provide all of the services currently being offered by the two archives, while better serving users interested in studies requiring both high energy and microwave data. Users will notice few immediate changes, but we will gradually fully integrate all the services of the archives.

Tags: cmb, cosmic-microwave-radiation, cosmology, heasarc, lambda
Organization: National Aeronautics and Space Administration
Communication Optimizations for a Wireless Distributed Prognostic Framework

Distributed architecture for prognostics is an essential step in prognostic research in order to enable feasible real-time system health management. Communication overhead is an important design problem for such systems. In this paper we focus on communication issues faced in the distributed implementation of an important class of algorithms for prognostics – particle filters. In spite of being computation and memory intensive, particle filters lend well to distributed implementation except for one significant step – resampling. We propose new resampling scheme called parameterized resampling that attempts to reduce communication between collaborating nodes in a distributed wireless sensor network. Analysis and comparison with relevant resampling schemes are also presented. A battery health management system is used as a target application.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Optimizing Battery Life for Electric UAVs using a Bayesian Framework

In summary, this paper lays a simple flight plan optimization strategy based on the particle filtering framework described in [5]. This is meant as a first step in formalizing computationally tractable stochastic programming techniques to optimally generate flight plans in response to battery life predictions. This approach takes advantage of the PF framework to simultaneously generate the optimal/sub-optimal flight plan simultaneously with predicting the RUL. Several steps lie ahead like a comparative analysis of alternative stochastic models in terms of optimality as well as computational cost. These options will need to be validated by flight tests where robustness to environmental conditions like air temperature and density as well as wind speed can be evaluated. The notion of risk-tolerance can be introduced via appropriate objective functions, thus allowing a non-zero risk of the dead stick condition in order to use more battery power.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Sensing and characterization of EMI during intermittent connector anomalies

This paper presents a new on-line methodology for detecting intermittent disconnection failures. The detection principle operates on the fundamental Lorentz Law that states that sudden changes in flux create a large voltage, resulting in an arc. This arc propagates as a traveling wave through the circuit until all the energy associated with it is dissipated. It is possible to detect that traveling wave as an indication of an intermittent disconnection failure. A test bench was implemented to test and validate the theory. Preliminary results presented in this paper show the feasibility of detecting disconnection failures and the possibility of locating the failing connector based on distance.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
OCO-3 Level 2 CO2 prior based on CO2 monthly flask record, global meteorology, and age of air, Forward Processing V10 (OCO3_L2_CO2Prior) at GES DISC

Version 10 is the current version of the data set. Older versions will no longer be available and are superseded by Version 10.

The Orbiting Carbon Observatory -3 (OCO-3) was deployed to the International Space Station in May, 2019. It is technically a single instrument, almost identical to OCO-2.

The Orbiting Carbon Observatory is the first NASA mission designed to collect space-based measurements of atmospheric carbon dioxide with the precision, resolution, and coverage needed to characterize the processes controlling its buildup in the atmosphere.

OCO-3 incorporates three high-resolution spectrometers that make coincident measurements of reflected sunlight in the near-infrared CO2 near 1.61 and 2.06 micrometers and in molecular oxygen (O2) A-Band at 0.76 micrometers. The three spectrometers have different characteristics and are calibrated independently. 

Oxygen-A Band cloud screening algorithm is one of the primary cloud screening tools implemented in the operational OCO processing pipeline. The algorithm was introduced and applied to early GOSAT data  with further analysis performed on OCO-2 simulations.

The OCO ABO2 algorithm employs a fast Bayesian retrieval to estimate surface pressure and surface albedo from high resolution spectra of the molecular oxygen (O2) A-band, near 0.765 µm. The radiative transfer forward model (FM) assumes a clear-sky condition, i.e. Rayleigh scattering only, such that differences between the modeled and measured radiances are apparent when the measurement scene contains cloud or aerosol.

Tags: atmosphere, atmospheric-chemistry, earth-science
Organization: National Aeronautics and Space Administration
CERES Bidirectional Scans NPP FM5 Edition1-CV

CER_BDS_NPP-FM5_Edition1-CV is the Clouds and the Earth's Radiant Energy System (CERES) Bidirectional Scans (BDS) Suomi National Polar-orbiting Partnership (NPP) Flight Model 5 (FM5) Edition 1-CV data product. Data collection for this product is ongoing. 

Please note that Edition1-CV data are for instrument validation purposes only and not suited for science publications.

CER_BDS_NPP-FM5_Edition1-CV data are CERES geolocated and calibrated Top-of Atmosphere (TOA) filtered radiances and other instrument data. Each CERES BDS data product contains twenty-four hours of Level-1B data for a CERES scanner instrument mounted on a spacecraft. BDS includes samples taken in normal and short Earth scan elevation profiles in both fixed and rotating azimuth scan modes (including space, internal calibration, and solar calibration views). BDS contains Level-0 raw (unconverted) science and instrument data as well as the geolocated converted science and instrument data. It also contains additional data not found in the Level-0 input file, including converted satellite position and velocity data, celestial data, converted digital status data, and parameters used in the radiance count conversion equations. 

CERES is a key component of the Earth Observing System (EOS) program. The CERES instruments provide radiometric measurements of the Earth's atmosphere from three broadband channels. The CERES missions are a follow-on to the successful Earth Radiation Budget Experiment (ERBE) mission. The first CERES instrument, protoflight model (PFM), was launched on November 27, 1997 as part of the Tropical Rainfall Measuring Mission (TRMM). Two CERES instruments (FM1 and FM2) were launched into polar orbit on board the Earth Observing System (EOS) flagship Terra on December 18, 1999. Two additional CERES instruments (FM3 and FM4) were launched on board Earth Observing System (EOS) Aqua on May 4, 2002. The CERES FM5 instrument was launched on board the Suomi NPP satellite on October 28, 2011. The newest CERES instrument (FM6) was launched on board the Joint Polar-Orbiting Satellite System 1 (JPSS-1) satellite, now called NOAA-20, on November 18, 2017.

Tags: atmosphere, atmospheric-radiation, earth-science, infrared-wavelengths, sensor-characteristics, spectral-engineering, visible-wavelengths
Organization: National Aeronautics and Space Administration
OCO-2 Level 2 spatially ordered geolocated retrievals screened using the IMAP-DOAS Preprocessor (IDP) V11.2 (OCO2_L2_IMAPDOAS) at GES DISC

Version 11.2 is the current version of the data set. Older versions will no longer be available and are superseded by Version 11.2.

The Orbiting Carbon Observatory is the first NASA mission designed to collect space-based measurements of atmospheric carbon dioxide with the precision, resolution, and coverage needed to characterize the processes controlling its buildup in the atmosphere. The OCO-2 project uses the LEOStar-2 spacecraft that carries a single instrument. It incorporates three high-resolution spectrometers that make coincident measurements of reflected sunlight in the near-infrared CO2 near 1.61 and 2.06 micrometers and in molecular oxygen (O2) A-Band at 0.76 micrometers. This collection encompass the output from the IMAP-DOAS preprocessor, which is used for both screening of the official XCO2 product as well as for the retrieval of Solar-Induced Fluorescence from the 0.76 micrometer O2 A-band. The IMAP-DOAS preprocessor, just as the ABO2 cloud screen, is implemented in the operational OCO-2 processing pipeline.

Tags: atmosphere, atmospheric-chemistry, earth-science
Organization: National Aeronautics and Space Administration
NASA Aerial Photography

The National Aeronautics and Space Administration (NASA) Aerial Photography
      data set is a film archive of photographs from the Lyndon B. Johnson Space
      Center (JSC) in Houston, Texas, and the NASA Ames Research Center in Moffett
      Field, California.  In 1965, the JSC initiated the Earth Resources Aircraft
      Program and began flying photographic missions for Federal Government agencies
      and other entities involved in remote sensing experiments.  Beginning in 1966,
      NASA conducted an Earth Observations Program, including Earth surveys using
      aircraft platforms.
      
      Photographs from a variety of NASA programs provide project-specific coverage
      over the United States, Grand Bahama, Jamaica, and Central America at base
      scales ranging from 1:16,000 scale to 1:450,000 scale.  Film types, scales,
      acquisition schedules, flight altitudes, and end products differ, according to
      project requirements.

Tags: earth-science, infrared-wavelengths, spectral-engineering, visible-wavelengths
Organization: National Aeronautics and Space Administration
OMI/Aura Ozone (O3) Total Column Daily L3 Global 0.25deg Lat/Lon Grid NRT

The OMI science team produces this Level-3 Aura/OMI Global TOMS-Like Total Column Ozone gridded product OMTO3e (0.25deg Lat/Lon grids). The OMTO3e product selects the best pixel (shortest path length) data from the good quality filtered level-2 total column ozone data (OMTO3) that fall in the 0.25 x 0.25 degree global grids. Each file contains total column ozone, radiative cloud fraction and solar and viewing zenith angles. OMTO3e files are stored in EOS Hierarchical Data Format (HDF-EOS5). Each file contains daily data from approximately 15 orbits. The maximum file size for the OMTO3e data product is about 2.8 Mbytes. (The shortname for this Level-3 TOMS-Like Total Column Ozone gridded product is OMTO3e) .

Tags: nasa
Organization: National Aeronautics and Space Administration
Understanding Human Error Based on Automated Analyses vol 1

A proactive approach to identifying and alleviating life-threatening conditions in the aviation system entails a well-defined process of identifying threats, evaluating causes, assessing risks, and implementing appropriate solutions. This process is not a trivial undertaking. It requires continuous monitoring of system performance in a non-punitive culture; learning from normal operational experience; comparing actual performance to expected performance; identifying the precursor events and conditions that foreshadow most accidents; designing appropriate interventions to minimize the risk of their occurrence; and having a system in place to monitor the efficacy of the interventions.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration