AndreaBozzo/ceres-open-data-index huggingface dataset:
Distributed Damage Estimation for Prognostics based on Structural Model Decomposition

Model-based prognostics approaches capture system knowl- edge in the form of physics-based models of components that include how they fail. These methods consist of a damage estimation phase, in which the health state of a component is estimated, and a prediction phase, in which the health state is projected forward in time to determine end of life. However, the damage estimation problem is often multi-dimensional and computationally intensive. We propose a model decom- position approach adapted from the diagnosis community, called possible conflicts, in order to both improve the com- putational efficiency of damage estimation, and formulate a damage estimation approach that is inherently distributed. Local state estimates are combined into a global state esti- mate from which prediction is performed. Using a centrifugal pump as a case study, we perform a number of simulation- based experiments to demonstrate the approach.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
VIIRS/JPSS1 CGF Snow Cover Daily L3 Global 375m SIN Grid V002

This data set contains daily 'cloud-free' snow cover produced from the VIIRS/JPSS-1 Snow Cover Daily L3 Global 375m SIN Grid, Version 2 snow cover product. A cloud-gap-filled algorithm is utilized to replace ‘cloud-covered’ pixels with ‘cloud-free pixels’ for the purpose of estimating the snow cover that may exist under current cloud cover. The data are provided daily and mapped to a 375 m sinusoidal grid.

Tags: cryosphere, earth-science, snow-ice
Organization: National Aeronautics and Space Administration
SMAPVEX19-22 Massachusetts Lidar Derived Digital Surface Model V001

These digital surface model (DSM) data consist of surface elevations derived from source lidar measurements collected in August 2022 in the vicinity of Petersham, MA during the SMAPVEX19-22 campaign. The location was selected due to its forested land cover, as SMAPVEX19-22 aims to validate satellite derived soil moisture estimates in forested areas. The August collection period was selected to characterize ‘leaf-on’ conditions. DSM data represents the highest elevation of features on the Earth’s surface, which may include bare-earth, vegetation, and human-made objects.

Tags: earth-science, land-surface, topography
Organization: National Aeronautics and Space Administration
Topic Modeling for OLAP on Multidimensional Text Databases: Topic Cube and its Applications

As the amount of textual information grows explosively in various kinds of business systems, it becomes more and more desirable to analyze both structured data records and unstructured text data simultaneously. Although online analytical processing (OLAP) techniques have been proven very useful for analyzing and mining structured data, they face challenges in handling text data. On the other hand, probabilistic topic models are among the most effective approaches to latent topic analysis and mining on text data. In this paper, we study a new data model called topic cube to combine OLAP with probabilistic topic modeling and enable OLAP on the dimension of text data in a multidimensional text database. Topic cube extends the traditional data cube to cope with a topic hierarchy and stores probabilistic content measures of text documents learned through a probabilistic topic model. To materialize topic cubes efficiently, we propose two heuristic aggregations to speed up the iterative Expectation-Maximization (EM) algorithm for estimating topic models by leveraging the models learned on component data cells to choose a good starting point for iteration. Experimental results show that these heuristic aggregations are much faster than the baseline method of computing each topic cube from scratch. We also discuss some potential uses of topic cube and show sample experimental results.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Land Surface Reflectance - GLS2010

The surface reflectance CDR is generated from specialized software called Landsat Ecosystem Disturbance Adaptive Processing System (LEDAPS). LEDAPS was originally developed through a National Aeronautics and Space Administration (NASA) Making Earth System Data Records for Use in Research Environments (MEaSUREs)grant by NASA Goddard Space Flight Center (GSFC) and the University of Maryland (Masek et al., 2006). The software applies Moderate Resolution Imaging Spectroradiometer (MODIS) atmospheric correction routines to Level-1 Landsat Thematic Mapper (TM) or Enhanced Thematic Mapper Plus (ETM+)data. Water,vapor, ozone, geopotential height, aerosol optical thickness,and digital elevation are input with Landsat data to the Second Simulation of a Satellite Signal in the Solar Spectrum (6S) radiative transfer models to generate top of atmosphere (TOA)reflectance, surface reflectance, brightness temperature, and masks for clouds, cloud shadows, adjacent clouds, land, and water.  The result is delivered as the Landsat surface reflectance CDR.

Tags: earth-science, land-surface, surface-radiative-properties, topography
Organization: National Aeronautics and Space Administration
Mars Technology Project

&lt;p&gt;
	NASA&amp;rsquo;s Mars Exploration Program (MEP) calls for a series of highly ambitious missions over the next decade and beyond. The overall goals of the MEP must be achieved with relatively low mission risk and within tightly constrained cost resources. The current overarching scientific goals of the MEP are: life, climate, geology, and preparation for human exploration. These have a common, measurable link: water. For Mars (like Earth), water is central to the planet&amp;rsquo;s history; it is also the primary reason for interest in it as a potentially habitable world. No new proposals are being solicited or funded in FY 2012 under this project line. Proposals for Mars instrument technology development are now included in PIDDP and no new awards will be provided under the Mars Instrument Development Program (MIDP).&lt;/p&gt;

Tags: active, nasa-headquarters, project
Organization: National Aeronautics and Space Administration
CAMEX-3 ER-2 Doppler Radar (EDOP) V1

The CAMEX-3 ER-2 Doppler Radar (EDOP) dataset is a browse-only dataset that consists of plotted reflectivity and Doppler velocity data collected by the ER-2 Doppler Radar (EDOP) during the third field campaign in the Convection And Moisture EXperiment (CAMEX) series, CAMEX-3. This field campaign took place from August to September 1998 based out of Patrick Air Force Base in Florida, with the purpose of studying the various aspects of tropical cyclones in the region. EDOP was mounted onboard the NASA ER-2 high-altitude research aircraft from which it obtained vertical profiles of convection within tropical cyclones. The daily browse files are available from August 5 through September 27, 1998 in GIF format.

Tags: earth-science, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
Sentinel-3A OLCI Level-3B Global Binned Earth-observation Reduced-Resolution (ERR) Inherent Optical Properties (IOP), Near Real-time (NRT) Data, version R2022.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: atmosphere, atmospheric-radiation, earth-science, ocean-optics, oceans
Organization: National Aeronautics and Space Administration
Comparison of Two Probabilistic Fatigue Damage Assessment Approaches Using Prognostic Performance Metrics

A general framework for probabilistic prognosis using maximum entropy approach, MRE, is proposed in this paper to include all available information and uncertainties for RUL prediction. Prognosis metrics are used for model comparison and performance evaluation. Several conclusions can be drawn based on the results in the current investigation: The proposed MRE updating approach results in more accurate and precise prediction compared with the classical Bayesian method. The classical Bayesian method is a special case of the proposed MRE approach and MRE approach is more flexible to include additional information for inference, which cannot be handled by the classical Bayesian method. The prognosis metrics can be successfully used for algorithm comparison and can give quantitative values in model (algorithm) performance evaluation. A robustness metric measuring the updating algorithmic sensitivity to prior uncertainty is proposed and applied to both Bayesian and MRE updating approaches. The application examples show that MRE exhibits more robustness against the uncertainty introduced by parameter distribution priors in the sense of prognosis performance. It is important to realize when to apply these metrics to arrive at meaningful interpretations. For instance, use of the convergence metric makes sense only when the algorithm predictions converge (get better) with time.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
LIMS/Nimbus-7 Level 3 Daily 2 deg Latitude Zonal Fourier Coefficients of O3, NO2, H2O, HNO3, Geopotential Height, and Temperature V006 (LIMSN7L3) at GES DISC

The Limb Infrared Monitor of the Stratosphere (LIMS) version 6 Level-3 data product consists of daily, 2 degree zonal Fourier coefficients, of vertical profiles of temperature, geopotential height, and mixing ratios of ozone (O3), nitrogen dioxide (NO2), water vapor (H2O), and nitric acid (HNO3). The data are on 28 pressure levels, equally spaced logarithmically, between 316 hPa and 0.01 hPa. Version 6 LIMS data have improved accuracy and precision of measured geophysical parameters.

The data files are in an ASCII text format compressed using gzip. The LIMS instrument was launched on the Nimbus-7 satellite and was operational from 25 October 1978 until May 28, 1979.

These data supercede the previous version 5 products, known as the LIMS Map Archival Tape (LAMAT) and the LIMS Seasonal Map Archival Tape (LASMAT).

Tags: altitude, atmosphere, atmospheric-chemistry, atmospheric-temperature, atmospheric-water-vapor, earth-science
Organization: National Aeronautics and Space Administration
Theoretically Optimal Distributed Anomaly Detection

A novel general framework for distributed anomaly detection with theoretical performance guarantees is proposed. Our algorithmic approach combines existing anomaly detection procedures with a novel method for computing global statistics using local sufficient statistics. Under a Gaussian assumption, our distributed algorithm is guaranteed to perform as well as its centralized counterpart, a condition we call Ôzero information lossÕ. We further report experimental results on synthetic as well as real-world data to demonstrate the viability of our approach.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Ground-Based Global Navigation Satellite System (GNSS) Galileo real-time POD Orbits  (60-second sampling, 60-second files) from NASA CDDIS

This product contains a time series of position and velocity components for healthy satellites in the Galileo constellation that are accumulated every minute throughout the day. In addition, formal 1-sigma uncertainties for the positions and velocities are provided. The product is generated at JPL's Global Differential GPS Operations Centers in real-time. The data in this product can be concatenated with other daily products to provide larger coverage in time.

Tags: earth-science, geodetics, gravity-gravitational-field, solid-earth, tectonics
Organization: National Aeronautics and Space Administration
RSW Mixed Element Cell-Centered Medium Mesh

This RSW gridset is designed as the medium size mixed element grid for use with cell-centered unstructured meshes.

UG3      : Grid File Name    = rsw_med_mixedcc.b8.ugrid
UG3      : Quad Surface Faces=     13056
UG3      : Tria Surface Faces=    107586
UG3      : Nodes             =   3819936
UG3      : Total Elements    =   8667521
UG3      : Hex Elements      =         0
UG3      : Pent_5 Elements   =     18324
UG3      : Pent_6 Elements   =   7010592
UG3      : Tet Elements      =   1638605
UG3      : BL Tet Elements   =     18000

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
A Compact Immersion Grating Spectrometer with Quantum Capacitance Detectors for Space-Borne Far-IR Spectroscopy Project

&lt;p&gt;SPECTROMETER:&amp;nbsp; The grating spectrometer uses a curved grating fabricated on a high resistivity silicon wafer. Light will be coupled in via a silicon immersion lens and coupling waveguide. The wafer profile, including the grating facets are defined by photolithography and deep reactive etching (DRIE) and the wafer is metallized on both sides for better light confinement (except in the regions below where the detector antennas will be placed).&amp;nbsp; The grating both focuses and diffracts the light in the plane of the wafer to a focal arc, where the detectors are positioned. QCD DETECTOR ARRAY: The Quantum Capacitance Detector is a mesoscopic superconducting device that exploits its extreme susceptibility to the presence of quasiparticle excitations arising from pair-breaking radiation to enable background limited detection.&amp;nbsp; QCDs have demonstrated photon noise limited performance&amp;nbsp; at 1.5THz for optical loadings 10-20 to 10-17W.&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; The detector die will be placed directly on top of the spectrometer wafer and will have an array of QCDs with antennas positioned at the focusing spots of each wavelength.&amp;nbsp; Each detector will be coupled to a superconducting resonator with a different resonant frequency to allow for frequency multiplexing with a single feedline coupling the RF signal to all resonators.&amp;nbsp; A&amp;nbsp; prototype with 32 spectral channels will be demonstrated&lt;/p&gt;

Tags: active, jet-propulsion-laboratory, project
Organization: National Aeronautics and Space Administration
Algorithms for Speeding up Distance-Based Outlier Detection

The problem of distance-based outlier detection is difficult
to solve efficiently in very large datasets because of potential
quadratic time complexity. We address this problem and
develop sequential and distributed algorithms that are significantly
more efficient than state-of-the-art methods while
still guaranteeing the same outliers. By combining simple
but effective indexing and disk block accessing techniques,
we have developed a sequential algorithm iOrca that is up to
an order-of-magnitude faster than the state-of-the-art. The
indexing scheme is based on sorting the data points in order
of increasing distance from a fixed reference point and
then accessing those points based on this sorted order. To
speed up the basic outlier detection technique, we develop
two distributed algorithms (DOoR and iDOoR) for modern
distributed multi-core clusters of machines, connected
on a ring topology. The first algorithm passes data blocks
from each machine around the ring, incrementally updating
the nearest neighbors of the points passed. By maintaining
a cutoff threshold, it is able to prune a large number
of points in a distributed fashion. The second distributed
algorithm extends this basic idea with the indexing scheme
discussed earlier. In our experiments, both distributed algorithms
exhibit significant improvements compared to the
state-of-the-art distributed methods.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Q-thruster Breadboard Campaign Project

&lt;p&gt;Q-thruster technology is a mission enabling form of electric propulsion and is already being traded by NASA&amp;#39;s Concept Architecture Team (CAT) &amp;amp; Human Space Flight (HSF) Architecture Team (HAT) as an electric propulsion effector for Asteroid Recovery Vehicle (ARV) mission extensibility options out to Mars.&amp;nbsp; The Nuclear Electric Propulsion mission allows for rapid transit while allowing for a heavy, more near-term reactor design and the Solar Electric Propulsion mission allows for a power starved approach with similar mission durations to Design Reference Architecture - DRA 5.0 that would not be possible without the Q-thruster technology.&lt;/p&gt;

Tags: active, johnson-space-center, project
Organization: National Aeronautics and Space Administration
Methods for Probabilistic Fault Diagnosis: An EPS Case Study

Health management systems that more accurately and quickly diagnose faults that may occur in different technical systems on-board a vehicle will play a key role in the success of future NASA missions. We discuss in this paper the diagnosis of abrupt continuous (or parametric) faults within the context of probabilistic graphical models, more specifically Bayesian networks that are compiled to arithmetic circuits. This paper extends our previous research, within the same probabilistic setting, on diagnosis of abrupt discrete faults. Our approach and diagnostic algorithm ProDiagnose are domain-independent; however we use an electrical power system testbed called ADAPT as a case study. In one set of ADAPT experiments, performed as part of the 2009 Diagnostic Challenge, our system turned out to have the best performance among all competitors. In a second set of experiments, we show how we have recently further significantly improved the performance of the probabilistic model of ADAPT. While these experiments are obtained for an electrical power system testbed, we believe they can easily be transitioned to real-world systems, thus promising to increase the success of future NASA missions.

**Reference:**

B. W. Ricks and O. J. Mengshoel, "Methods for Probabilistic Fault Diagnosis: An Electrical Power System Case Study."  In Proc. of the First Annual Conference of the Prognostics and Health Management Society (PHM-09), San Diego, CA, September 27 – October 1, 2009.

**BibTex Reference:**

@inproceedings{ricks09methods,
  author    = {Ricks, B. W. and Mengshoel, O. J.},
  title     = {Methods for Probabilistic Fault Diagnosis: An Electrical Power System Case Study},
  booktitle = {Proc. of the Annual Conference of the Prognostics and Health Management Society (PHM-09)},
  address   = {San Diego, CA},  month     = sep,
  year      = {2009}
}

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
OCO-3 Level 1B calibrated, geolocated calibration spectra, Retrospective Processing V10r (OCO3_L1B_Calibration) at GES DISC

Version 10r is the current version of the data set. Older versions will no longer be available and are superseded by Version 10r.

The Orbiting Carbon Observatory -3 (OCO-3) was deployed to the International Space Station in May, 2019. It is technically a single instrument, almost identical to OCO-2.

The Orbiting Carbon Observatory is the first NASA mission designed to collect space-based measurements of atmospheric carbon dioxide with the precision, resolution, and coverage needed to characterize the processes controlling its buildup in the atmosphere. 

The OCO-3 incorporates three high-resolution spectrometers that make coincident measurements ofreflected sunlight in the near-infrared CO2 near 1.61 and 2.06 micrometers and in molecular oxygen (O2) A-Band at 0.76 micrometers. The three spectrometers have different characteristics and are calibrated independently. Their raw data numbers (DN) are delivered correlated in time to the Level 1B process as Level 1A products. Each band has 1016 spectralelements, although some are masked out in the L2 retrieval.

This L1B product results from calibration mode measurements (e.g., Lunar,Solar, Dark observations), and thus it differs from the OCO3_L1B_Science(L1bSc) product. The differences in the product formats are only in the geolocation information provided. Whereas the L1bSc products report geolocation data for each sounding, calibration products report the directionof the boresight vector.This is the retrospective processing where the calibration data is estimated from the full timeseries of data (before, during, and after the measurements), and is expected to be of slightly higher quality.

This is the retrospective processing where the calibration data is estimated from the full timeseries of data (before, during, and after the measurements), and is expected to be of slightly higher quality.

Tags: atmosphere, atmospheric-chemistry, earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
Modeling of Activities as Fuzzy Temporal Multivariable Problems

Smart Home resident may be an Alzheimer patient needing continuous assistance and care giving. Because of forgetfulness, this person may realize activities of daily living erroneously. In order to assist this person automatically in Smart Home, all his performed actions and activities are observed through the embedded sensors of Smart Home, and applying the data mining techniques his activities are analyzed. Then information about his activities is provided and in the consequence, comparing learned correct patterns and current observations the Smart Home may infer provision of assistance to this person at the appropriate moment. In this paper we propose a data-driven activity modeling approach, which supports reasoning in correct realization of the activities. Activities are presumed as the series of fuzzy events that occur shortly one after another. Per each activity, we calculate a fuzzy conceptual structure, and the model of activity is represented in form of a multivariable problem.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
OMPS-NPP LP NRT L2 LP Ozone (O3) Vertical Profile swath daily Center slit V2.6

Version 2.6 is the current version of this data product, and supersedes all previous versions.The OMPS-NPP L2 LP Ozone (O3) Vertical Profile swath daily Center slit collection contains ozone measured by the Ozone Mapping and Profiling Suite (OMPS) Limb-Profiler (LP) sensor on the Suomi-NPP satellite in Near Real Time (NRT). The LP ozone product measures the vertical distribution of ozone in the stratosphere and lower mesosphere. The algorithm derives ozone profile values along with errors in the UV from 29.5 km and 52.5 km, and in the visible from cloud top to 37.5 km (when there are no clouds the lower limit is 12.5 km). See the README for full description of the product and updated retrieval algorithm.Each granule contains data from the daylight portion of each orbit measured for a full day. Spatial coverage is global (-90 to  90 degrees latitude), and there are about 14.5 orbits per day, the data from the center of the LP three slits are used to make a vertical profile. The profile is measured from the ground up to about 60 km with a vertical resolution of the retrieved profiles of approximately 1.8 km.The data are written using the Hierarchical Data Format Version 5 or HDF5.

Tags: atmosphere, atmospheric-chemistry, earth-science
Organization: National Aeronautics and Space Administration