AndreaBozzo/ceres-open-data-index huggingface dataset:
Discovery of Recurring Anomalies in Text Reports

This paper describes the results of a significant research and development effort conducted at NASA Ames Research Center to develop new text mining algorithms to discover anomalies in free-text reports regarding system health and safety of two aerospace systems. We discuss two problems of significant import in the aviation industry. The first problem is that of automatic anomaly discovery concerning an aerospace system through the analysis of tens of thousands of free-text problem reports that are written about the system. The second problem that we address is that of automatic discovery of recurring anomalies, i.e., anomalies that may be described in different ways by different authors, at varying times and under varying conditions, but that are truly about the same part of the system. The intent of recurring anomaly identification is to determine project or system weakness or high-risk issues. The discovery of recurring anomalies is a key goal in building safe, reliable, and cost-effective aerospace systems.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
GLAS/ICESat L2 Global Aerosol Vertical Structure Data (HDF5) V033

GLAH10 Level-2 aerosol vertical structure data contain the attenuation-corrected cloud and aerosol backscatter and extinction profiles at a 4 sec sampling rate for aerosols and a 1 sec rate for clouds.  Each data granule has an associated browse product.

Tags: aerosols, atmosphere, atmospheric-radiation, clouds, earth-science
Organization: National Aeronautics and Space Administration
Prognostics in Battery Health Management

Batteries represent complex systems whose internal state vari- ables are either inaccessible to sensors or hard to measure un- der operational conditions. This work exemplifies how more detailed model information and more sophisticated prediction techniques can improve both the accuracy as well as the re- sidual uncertainty of the prediction in Prognostics and Health Management. The more dramatic performance improvement between various prediction techniques is in their ability to learn complex non-linear degradation behavior from the train- ing data and discard any external noise disturbances.
An algorithm that manages these sources of uncertainty well can yield higher confidence in predictions, expressed by narrower uncertainty bounds. We observed that the particle filter approach results in RUL distributions which have better precision (narrower pdfs) by several σs (if approximated as Gaussian) as compared to the other regression methods. How- ever, PF requires a more complex implementation and compu- tational overhead than the other methods. This illustrates the basic tradeoff between modeling and algorithm development versus prediction accuracy and precision. For situations like battery health management where the rate of capacity degrada- tion is rather slow, one can rely on simple regression methods that tend to perform well as more data are accumulated and still predict far enough in advance to avoid any catastrophic failures. Techniques like GPR or even the baseline approach can offer a suitable platform in these situations by managing the uncertainty fairly well with much simpler implementations. Other data sets may allow much smaller prediction horizons and hence require precise techniques like particle filters.
In this study, we conclude that there are several methods one could employ for battery health management applica- tions. Based on end user requirements and available resources, a choice can be made between simple or more elegant tech- niques. The particle filter based approach emerges as the winner when accuracy and precision are considered more important than other requirements.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
SMAP_L1B_SIGMA_NAUGHT_LOW_RES_METADATA_V002

SMAP Level 1B Sigma Naught Low Res Product Metadata Version 2

Tags: active-remote-sensing, earth-observation-satellites, earth-remote-sensing-instruments, earth-science, imaging-radars, nasa-decadal-survey, platform-characteristics, radar, smap, spectral-engineering
Organization: National Aeronautics and Space Administration
Aviation System Monitoring and Modeling Project

Air transportation, one of the most important modes of transportation, is also one of the safest. Nevertheless, the public demands that safety levels continuously improve and that the absolute number of aviation accidents continue to decline, even as air-traffic levels increase.  On February 12, 1997, after the tragedy of TWA 800, President William J. Clinton declared,
“We will achieve a national goal of reducing the fatal aircraft accident rate by 80% within 10 years.”
 
In response to this presidential declaration, the administrator of NASA announced that NASA would undertake a new program in aviation safety in support of this objective. NASA quickly formed the Aviation Safety Investment Strategy Team (ASIST) in collaboration with the Federal Aviation Administration (FAA) and the National Transportation Safety Board (NTSB), which organized a series of five workshops to examine the options and recommend an approach for NASA to develop the enabling technologies that address the president's goal. The exceptional and dedicated participation from all sectors of the aviation industry in the development of NASA’s strategy was remarkable.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Center Innovation Fund: JPL CIF Program

&lt;p&gt;Funds are distributed to each NASA Center to support emerging technologies and creative initiatives that leverage Center talent and capabilities. NASA scientists and engineers will lead projects and partnerships among Centers and with other agencies, research laboratories, academia and private industry are encouraged.&lt;/p&gt;

Tags: active, jet-propulsion-laboratory, jpl-cif, program
Organization: National Aeronautics and Space Administration
Probabilistic Delamination Diagnosis of Composite Materials Using a Novel Bayesian Imaging Method

In this paper, a probabilistic delamination location and size detection framework is proposed. The delamination probability image using Lamb wave-based damage detection is constructed using the Bayesian updating technique. First, the algorithm for the probabilistic delamination detection framework using Bayesian updating (Bayesian Imaging Method - BIM) is proposed. Following this, the composite coupon fatigue testing setup is introduced and the corresponding lamb wave diagnosis signal is collected and interpreted. Next, the obtained signal features are incorporated in the Bayesian Imaging Method to detect delamination size and location, as well as their confidence bounds. The damage detection results using the proposed methodology are compared with X-ray images for verification and validation. Finally, some conclusions and future works are drawn based on the proposed study.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
IceBridge UAF Lidar Profiler L1B Geolocated Surface Elevation Triplets V001

This data set contains surface profiles of Alaska Glaciers acquired using the airborne University of Alaska Fairbanks (UAF) Glacier Lidar system. The data were collected as part of Operation IceBridge funded aircraft survey campaigns.

Tags: cryosphere, earth-science, glaciers-ice-sheets
Organization: National Aeronautics and Space Administration
FTPBrowser at the Space Physics Data Facility (SPDF)

FTPBrowser at GSFC/SPDF is an interface for graphical or digital display and/or retrieval of subsets of data that are in selected ones of SPDF's ftp-accessible ASCII or g-zipped ASCII data sets. The Space Physics Data Facility (SPDF) is the archive of non-solar data for the Heliospheric Science Division (HSD) at NASA's Goddard Space Flight Center.

Tags: astrophysics, heliophysics, space-missions, space-physics, space-science
Organization: National Aeronautics and Space Administration
GPM GROUND VALIDATION DUAL POLARIZED C-BAND DOPPLER RADAR KING CITY GCPEX V1

The GPM Ground Validation Dual Polarized C-Band Doppler Radar King City GCPEx dataset has special Range Height Indicator (RHI) and sector scans of several dual polarization parameters, such as temperature and reflectivity, measured by the C-Band radar during the GPM Cold-season Precipitation Experiment (GCPEx) in Ontario, Canada. Additionally, specially configured Centre for Atmospheric Research Experiments (CARE)-centric composites were also generated. Standard King City Radar (WKR) Interactive Radar Information System (IRIS) volume and Plan Position Indicator (PPI) scans, along with corresponding standard PPI imagery, are also included. Data was collected from January 15, 2012 through March 3, 2012.

Tags: earth-science, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
HIRENASD Unstructured Grids - Centaur software

These grids were constructed using Centaur software at DLR in Germany. The grids designed for node based (labeled 'cv') and cell-centered solvers (labeled 'cc') are supplied. Grids with mixed elements only are supplied.

Each mixed elements tar-file contains grid in TAU software native format '.nc','.bmap'.  The grid was converted into '.cgns' format.  In some instances, the grids in TAU native formats were converted into aflr3 format at NASA Langley '.ugrid','.mapbc' which in turn were converted to the 'ugrid.cgns' formats.


Some files were too large and had to be split into parts. To combine the parts, use cat filename_part1 filename_part2 > filename.

Grids are in units of 'mm'.  

Please report any issues with these grids to Markus.Ritter@dlr.de and Pawel.Chwalowski@nasa.gov

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Enceladus Results

Here are some results from the Spectra Decomposition Algorithm on infrared spectral images of Saturn's moon Enceladus.

 

Figure 1  is the spatial contribution of the 2nd component. Notice the hot spot in red around the bottom left hand side. The hot spot correspond to a higher contribution of this component located at the "tiger scratch" features on the moon.

 

Figure 2  is the spectral component, which exhibits a pattern that indicates absorption of light due to the presence of CO2.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
GIFWalk at the Space Physics Data Facility (SPDF)

GIFWalk is an interface allowing the user to browse pre-generated data and orbit plots from missions including ACE, Cluster, Geotail, THEMIS, Polar, IMAGE, IMP 8, Wind, and Van Allen Probes (RBSP). The Space Physics Data Facility (SPDF) is the archive of non-solar data for the Heliospheric Science Division (HSD) at NASA's Goddard Space Flight Center.

Tags: astrophysics, heliophysics, space-missions, space-physics, space-science
Organization: National Aeronautics and Space Administration
CDDIS_VLBI_products_positions

Station positions and velocity solutions in Software INdependent EXchange (SINEX) format derived from analysis of Very Long Baseline Interferometry (VLBI) data. These products are the generated by analysis centers in support of the International VLBI Service for Geodesy and Astrometry (IVS) and combined by the IVS analysis coordinator to form the official IVS station position product.

Tags: nasa
Organization: National Aeronautics and Space Administration
Committee on Earth Observation Satellites (CEOS) International Directory Portal

The CEOS IDN is an international effort developed to assist researchers in locating information on available datasets and services.  The directory is sponsored as a service to the Earth science community.

Tags: agriculture, atmosphere, biological, biosphere, classification, climate-indicators, cryosphere, earth-science, human-dimensions, land-surface, oceans, paleoclimate, solid-earth, spectral-engineering, sun-earth-interactions, terrestrial-hydrosphere
Organization: National Aeronautics and Space Administration
HRIR/Nimbus-1 Images of Nighttime Brightness Temperature on 70 mm Film V001 (HRIRN1IM) at GES DISC

HRIRN1IM is the Nimbus-1 High-Resolution Infrared Radiometer (HRIR) data product containing scanned negatives of photofacsimile 70mm film strips. The images contain orbital nighttime (3.5 to 4.1 microns) brightness temperature values showing cloud cover and the Earth's surface temperature. Each orbital swath picture is gridded with geographic coordinates and covers a distance approximately from the north pole to the south pole. The images are saved as JPEG 2000 digital files. About 7 days of images are archived into a TAR file. The processing techniques used to produce the data set and a full description of the data are contained in section 3.4.1 of the "Nimbus I Users' Guide."

The HRIR instrument was designed to perform two major functions: first to map the Earth's cloud cover at night to complement the television coverage during the daytime portion of the orbit, and second to measure the temperature of cloud tops and terrain features. The HRIR instrument was launched on the Nimbus-1 satellite and was operational from August 28, 1964 through September 22, 1964.

This product was previously available from the NSSDC with the identifier ESAD-00135 (old ID 64-052A-03B).

Tags: earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
MODIS/Aqua CGF Snow Cover Daily L3 Global 500m SIN Grid V061

This global Level-3 data set (MYD10A1F) provides daily cloud-free snow cover derived from the MODIS/Aqua Snow Cover Daily L3 Global 500m SIN Grid data set (MYD10A1). Grid cells in MYD10A1 which are obscured by cloud cover are filled by retaining clear-sky views of the surface from previous days. A separate parameter is provided which tracks the number of days in each cell since the last clear-sky observation. Each data granule contains a 10° x 10° tile projected to the 500 m sinusoidal grid.

The terms "Version 61" and "Collection 6.1" are used interchangeably in reference to this release of MODIS data.

Tags: cryosphere, earth-science, national-geospatial-data-asset, ngda, snow-ice
Organization: National Aeronautics and Space Administration
Novel Methods for Predicting Photometric Redshifts

We calculate photometric redshifts from the Sloan Digital Sky Survey Main Galaxy Sample, The Galaxy Evolution Explorer All Sky Survey, and The Two Micron All Sky Survey using two new training-set methods.  We utilize the broad-band photometry from the three surveys alongside Sloan Digital Sky Survey measures of photometric quality and galaxy morphology. Our first training-set method draws from the theory of ensemble learning while the second employs Gaussian process regression both of which allow for the estimation of redshift along with a measure of uncertainty in the estimation. The Gaussian process models the data very effectively with small training samples of approximately 1000 points or less. These two methods are compared to a well known Artificial Neural Network training-set method and to simple linear and quadratic regression. We also demonstrate the need to provide confidence bands on the error estimation made by both classes of models.  Our results indicate that variations due to the optimization procedure used for almost all neural networks, combined with the variations due to the data sample, can produce models with variations in accuracy that span an order of magnitude. A key contribution of this paper is to quantify the variability in the quality of results as a function of model and training sample.  We show how simply choosing the ``best" model given a data set and model class can produce misleading results.  We also investigate supplemental information provided by the Sloan Digital Sky Survey photometric pipeline related to photometric quality and galaxy morphology tracers. We show that, using these additional quality and morphology indicators rather than only the Sloan Digital Sky Survey broad-band u,g,r,i,z imaging data commonly used, one can improve redshift accuracy by 10s of percent. Near Infrared LaTeX  broad-band photometry provided from the Two Micron All Sky Survey and near-ultraviolet and far-ultraviolet broad-band data from The Galaxy Evolution Explorer All Sky Survey are also investigated where they overlap with the Sloan Digital Sky Survey. Our results show that robust photometric redshift errors as low as 0.02 RMS can regularly be obtained. We believe these can be expanded to other photometric surveys where sufficient redshift calibration objects exist.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
CALFIN Subseasonal Greenland Glacial Terminus Positions V001

This data set contains shapefiles of Greenland’s glacial termini and basins for the years 1972 to 2019. These vector data were created from Landsat 1-8 satellite imagery using the Calving Front Machine (CALFIN) an automated processing workflow utilizing neural networks for extracting calving fronts from satellite images of marine-terminating glaciers.

Tags: cryosphere, earth-science, glaciers-ice-sheets
Organization: National Aeronautics and Space Administration
IceBridge Narrow Swath ATM L1B Qfit Elevation and Return Strength V001

This data set contains spot elevation measurements of Greenland, Arctic, and Antarctic sea ice acquired using the NASA Airborne Topographic Mapper (ATM) 4CT3 narrow scan instrumentation. The data were collected as part of Operation IceBridge funded aircraft survey campaigns.

Tags: cryosphere, earth-science, sea-ice
Organization: National Aeronautics and Space Administration
SMAPVEX12 Vegetation Water Content Map V001

The daily Vegetation Water Content (VWC) maps for the Soil Moisture Active Passive Validation Experiment 2012 (SMAPVEX12) were derived by calculating Normalized Difference Vegetation Index (NDVI) from SPOT and RapidEye satellite overpasses and then interpolating it for each day of the campaign. In addition, samples from a range of vegetation types were used to compare ground-based measurements to the satellite-based estimates.

Tags: biosphere, earth-science, vegetation
Organization: National Aeronautics and Space Administration
TRMM Attitude and VIRS Packets and Header Record L1A V7 (TRMM_1A01) at GES DISC

The Level-1A Product file, "1A01", is a concatenation of Header record, Spacecraft Attitude packets, VIRS Housekeeping Data packets, VIRS Science Data packets, QACs, and an MDUL.
As such, it is reversible to Level 0. The header record contains information pertaining to orbit times, orbit number, times of the first scan, and number of scans, among other things. The Level 0 data contain the actual channel data expressed as "sensor counts". A Level 1A file contains data for a single orbit and has a file size of about 31 MB (uncompressed).  There are 16 files of VIRS 1A01 data produced per day.

The Visible and Infrared Scanner (VIRS) is a five-channel visible/infrared radiometer, which builds on the heritage of theAdvanced Very High Resolution Radiometer (AVHRR) instrument flown aboard the NOAA series of Polar-Orbiting Operational EnvironmentalSatellites (POES). The VIRS detects radiation at 1 visible, 2 near infrared and 2 thermal infrared wavelengths, allowing determination of cloud coverage, cloud top height and temperature, and precipitation indices. The central wavelengths for the VIRS channels are 0.63, 1.60,3.75, 10.8, and 12.0 microns. All channels are in operation during the daytime, but only channels 3, 4 and 5 operate during the nighttime.

Spatial coverage is between 38 degrees North and 38 degrees South owing to the 35 degree inclination of the TRMM satellite. This orbit provides extensive coverage in the tropics and allows each location to be covered at a different local time each day, enabling the analysis of the diurnal cycle of precipitation.

Tags: earth-science, infrared-wavelengths, platform-characteristics, sensor-characteristics, spectral-engineering, visible-wavelengths
Organization: National Aeronautics and Space Administration
AMSR-E/AMSR2 Unified L2B Global Swath Ocean Products V001

This AMSR Unified global ocean data set reports integrated water vapor and cloud liquid water content in the atmospheric column, plus 10-meter sea surface wind speeds. The data are derived from AMSR-E  and AMSR2  brightness temperature observations that have been resampled by the Japan Aerospace Exploration Agency (JAXA) to facilitate an intercalibrated (i.e., “unified”) AMSR-E/AMSR2 data record. Ancillary files, including product history, quality assessment (QA), and file-specific metadata are also available.

Tags: atmosphere, atmospheric-water-vapor, clouds, earth-science, ocean-winds, oceans
Organization: National Aeronautics and Space Administration
DXC'09 Industrial Track Sample Data

Sample data, including nominal and faulty scenarios, for Tier 1 and Tier 2 of the First International Diagnostic Competition. Three file formats are provided, tab-delimited .txt files, Matlab .mat files, and tab-delimited .scn files. The scenario (.scn) files are read by the DXC framework. See the Support/Documentation section below and the First International Diagnostic Competition project page for more information.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
SENTINEL-1A_DUAL_POL_METADATA_GRD_MEDIUM_RES

Sentinel-1A Dual-pol ground projected medium resolution metadata

Tags: agriculture, biosphere, coastal-processes, cryosphere, earth-science, erosion-sedimentation, forest-science, frozen-ground, geomorphic-landforms-processes, glaciers-ice-sheets, land-surface, land-use-land-cover, landscape, ocean-waves, ocean-winds, oceans, sea-ice, snow-ice, solid-earth, surface-water, tectonics, terrestrial-ecosystems, terrestrial-hydrosphere, topography
Organization: National Aeronautics and Space Administration
ABoVE: Passive Microwave-derived Annual Snowpack Main Melt Onset Date Maps, 1988-2018

This dataset provides the annual date of snowpack seasonal beginning melt (i.e., main melt onset date, MMOD) across northwest Canada; Alaska, U.S.; and parts of far eastern Russia at 6.25 km resolution for the period 1988-2018. MMOD was derived from the daily 19V (K-band) and 37V (Ka-band) GHz bands from the Making Earth Science Data Records for Use in Research Environments (MEaSUREs) Calibrated Enhanced-Resolution Passive Microwave (PMW) EASE-Grid Brightness Temperature (Tb) Earth System Data Record (ESDR). The PMW MMOD dataset was validated using the transition date from Freeze Degree Days (FDD) to Thaw Degree Days (TDD) from in situ air temperature observations from 31 SNOw TELemetry network (SNOTEL) observations, and compared to the established Freeze-Thaw ESDR (FT-ESDR) spring onset date. The resulting MMOD data record is suitable for documenting the spatial-temporal impacts of MMOD variability in ecosystem services, wildlife movements, and hydrologic processes across the ABoVE domain. The data from 1988-2016 included a coastal mask removing coastal pixels due to potential water contamination from coarse brightness temperature observations (Dersken et al., 2012). There is not a coastal mask for the 2017-2018 data. The full data are included, and data users should be aware that coastal values can be adversely affected by adjacent water bodies.

Tags: climate-indicators, cryosphere, cryospheric-indicators, earth-science, snow-ice, terrestrial-hydrosphere
Organization: National Aeronautics and Space Administration
Comparison of gene expression profiles of normal human bronchial epithelial cells in 2D and 3D cultural conditions

The experiment is part of a project to study DNA repair process after ionizing radiation in organotypic 3-dimentional human bronchial epithlial cell culture. Human bronchial epithelial cells were grown in tissue culture flask (2D) or in matrics gel (3D). Three independent cultures were done for each condition.

Tags: bioassay_data_transformation, culture-condition, feature_extraction, hybridization, image_aquisition, ionizing-radiation, labeling, nucleic_acid_extraction, p-gse27520-1, p-gse27520-2, p-gse27520-3, p-gse27520-4, p-gse27520-5, p-gse27520-6
Organization: National Aeronautics and Space Administration