AndreaBozzo/ceres-open-data-index huggingface dataset:
GPM Ground Validation NCAR Particle Probes IPHEx V1

The GPM Ground Validation NCAR Particle Probes IPHEx dataset consists of Ice Water Content (IWC), particle number concentration normalized by bin width, and total particle number concentration data that were collected from three particle probes onboard the University of North Dakota (UND) Citation II aircraft during the Global Precipitation Mission (GPM) Ground Validation Integrated Precipitation and Hydrology Experiment (IPHEx). These instruments include the PMS Two-Dimensional Cloud probe (2D-C), the SPEC Two-Dimensional Stereo probe (2D-S), and the SPEC High Volume Precipitation Spectrometer version 3 (HVPS-3). The IPHEx campaign took place in North Carolina with the goal of evaluating the accuracy of satellite precipitation measurements and using the collected data for hydrology models in the region. The campaign’s intense study period occurred from May 1 through June 15, 2014. All instruments are two-dimensional optical array probes which record images of particles that travel through the sampling area. The data files are available from May 9 through June 12, 2014 in ASCII format using the NASA Ames format specification. Browse images of instrument array 5-sec measurements are available in PNG format.

Tags: atmosphere, clouds, earth-science
Organization: National Aeronautics and Space Administration
A Survey of Artificial Intelligence for Prognostics

Integrated Systems Health Management includes as key elements fault detection, fault diagnostics, and failure prognostics. Whereas fault detection and diagnostics have been the subject of considerable emphasis in the Artificial Intelligence (AI) community in the past, prognostics has not enjoyed the same attention. The reason for this lack of attention is in part because prognostics as a discipline has only recently been recognized as a game-changing technology that can push the boundary of systems health management. This paper provides a survey of AI techniques applied to prognostics. The paper is an update to our previously published survey of data-driven prognostics.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Global Forecast System (GFS) CPEX V1

The Global Forecast System (GFS) CPEX dataset includes model data simulated by the Global Forecast System (GFS) model for the Convective Process Experiment (CPEX) field campaign. The NASA Convective Processes Experiment (CPEX) aircraft field campaign took place in the North Atlantic-Gulf of Mexico-Caribbean Sea region from 25 May-25 June 2017. CPEX conducted a total of sixteen DC-8 missions from 27 May-24 June. The CPEX campaign collected data to help explain convective storm initiation, organization, growth, and dissipation in the North Atlantic-Gulf of Mexico-Caribbean Oceanic region during the early summer of 2017. These data are available from May 24, 2017 through July 20, 2017 and are available in netCDF-3 format.

Tags: atmosphere, atmospheric-temperature, atmospheric-water-vapor, atmospheric-winds, earth-science, precipitation
Organization: National Aeronautics and Space Administration
Gazetteer of Planetary Nomenclature: Venus: 1:10 million-scale Altimetry Quadrangles: Aphrodite

This set of maps diplays altimetric radar images of Venus approved by the International Astronomical Union (IAU).

Tags: altimetry, imagery, images, planets, quadrangles, radar, usgs, venus, working-group-for-planetary-system-nomenclature
Organization: National Aeronautics and Space Administration
Soil Moisture Active Passive (SMAP) L4 Carbon Ancillary Meteorology Preprocessor Output Log Files V001

This ancillary SMAP product contains daily meteorological model log files, including model outputs. The meteorological model is derived from the Modern-Era Retrospective Analysis for Research and Applications (MERRA) data set and used as an input in the SMAP L4 Carbon algorithm.

Tags: ancillary-models, earth-science, models
Organization: National Aeronautics and Space Administration
Gazetteer of Planetary Nomenclature: Jovian System: Thebe

These images display several of Jupiter's moons approved by the International Astronomical Union (IAU).

Tags: amalthea, callisto, europa, ganymede, imagery, images, io, jovian, jupiter, moons, thebe, usgs, working-group-for-planetary-system-nomenclature
Organization: National Aeronautics and Space Administration
IceBridge LVIS L1B Geolocated Return Energy Waveforms V002

This data set contains return energy waveform data measured over Greenland, Alaska, and Antarctica by the NASA Land, Vegetation, and Ice Sensor (LVIS), an airborne lidar scanning laser altimeter. The data were collected as part of Operation IceBridge funded campaigns.

Tags: earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
IceBridge Riegl Laser Altimeter L2 Geolocated Surface Elevation Triplets V001

This data set contains surface range values for Antarctica and Greenland derived from measurements captured by the Riegl Laser Altimeter. The data were collected by scientists working on the Investigating the Cryospheric Evolution of the Central Antarctic Plate (ICECAP) project, which is funded by the National Science Foundation (NSF) and the Natural Environment Research Council (NERC) with additional support from NASA Operation IceBridge.

Tags: earth-science, land-surface, topography
Organization: National Aeronautics and Space Administration
NASA 3D Models: Aqua

Aqua carries six state-of-the-art instruments to observe the Earth's oceans, atmosphere, land, ice and snow covers, and vegetation, providing high measurement accuracy, spatial detail, and temporal frequency. This comprehensive approach to data collection enables scientists to study the interactions among the four spheres of the Earth system -- the oceans, land, atmosphere, and biosphere.

Tags: 3d-model, a-train, aqua, earth-science, eyes-on-the-earth-3d, satellite, spacecraft, water
Organization: National Aeronautics and Space Administration
TRMM TMI/PR Combined Gridded Orbital Spectral Latent Heating L3 1.5 hours 0.5 degree x 0.5 degree V7 (TRMM_3G31) at GES DISC

3G31, Gridded Orbital Convective Stratiform Heating from Combined, produces 0.5 degree x 0.5 degree orbital apparent heating profiles from surface convective rainfall rate and surface stratiform rainfall rate. The granule size is one orbit.

Tags: atmosphere, clouds, earth-science
Organization: National Aeronautics and Space Administration
SENTINEL-1A_SINGLE_POL_GRD_FULL_RES

Sentinel-1A Single-pol ground range detected full resolution images

Tags: agriculture, biosphere, coastal-processes, cryosphere, earth-science, erosion-sedimentation, forest-science, frozen-ground, geomorphic-landforms-processes, glaciers-ice-sheets, land-surface, land-use-land-cover, landscape, ocean-waves, ocean-winds, oceans, sea-ice, snow-ice, solid-earth, surface-water, tectonics, terrestrial-ecosystems, terrestrial-hydrosphere, topography
Organization: National Aeronautics and Space Administration
ATTREX-Aircraft_Radiation_Measurements

ATTREX-Aircraft_Radiation_Measurements are in-situ radiation measurements collected onboard the Global Hawk Unihabited Aerial System (UAS) during the Airborne Tropical TRopopause EXperiment (ATTREX) campaign. This collection consists of in-situ radiation properties collected by the Solar Spectral Flux Radiometer (SSFR) during the 2011 and 2013 deployments over California, and 2014 deployment over Guam. Data collection is complete.
Even though it is typically found in low concentrations, stratospheric water vapor has large impacts on the Earth’s climate and energy budget. Studies have suggested that even relatively small changes in stratospheric humidity may have significant climate impacts and future changes in stratospheric humidity and ozone concentration in response to a changing climate are significant climate feedback. Tropospheric water vapor climate feedback is typically well represented in global models. However, predictions of future changes in stratospheric humidity are highly uncertain due to gaps in our understanding of physical processes occurring in the region of the atmosphere that controls the composition of the stratosphere, the Tropical Tropopause Layer (TTL, ~13-18 km). The ability to predict future changes in stratospheric ozone are also limited due to uncertainties in the chemical composition of the TTL. In order to address these uncertainties, the Airborne Tropical Tropopause Experiment (ATTREX) was completed. Instruments during ATTREX provided measurements to trace the movement of reactive halogen-containing compounds and other important chemical species, the size and shape of cirrus cloud particles, water vapor, and winds in three dimensions through the TTL. Bromine-containing gases were measured to improve understanding of stratospheric ozone. ATTREX consisted of four NASA Global Hawk Uninhabited Aerial System (UAS) campaigns deployed from NASA’s Armstrong Flight Research Center (formally Dryden Flight Research Center). Campaigns were deployed over Edwards, CA, Guam, Hawaii, and Darwin, Australia in Boreal summer, winter, fall, and summer, respectively.

Tags: atmosphere, atmospheric-radiation, earth-science
Organization: National Aeronautics and Space Administration
ADVANCED MICROWAVE SOUNDING UNIT-A (AMSU-A) SWATH FROM NOAA-16 V1

AMSU-A, the Advanced Microwave Sounding Unit, is a 15-channel passive microwave radiometer used to profile atmospheric temperature and moisture from the earth's surface to ~45 km (3 millibars). All orbits beginning in the day (00:00:00 - 23:59:59 UTC) are stored in one daily HDF-EOS file. Each file contains 15 (channel) arrays, as well as corresponding latitude, longitude, and time. AMSU flies on the National Oceanic and Atmospheric Administration (NOAA) polar orbiting spacecraft as part of the National Polar-orbiting Operational Environmental Satellite System (NPOESS). Launched on 21 September 2000, NOAA-16 is in a sun synchronous near polar orbit.

Tags: atmosphere, atmospheric-temperature, atmospheric-water-vapor, earth-science, microwave, spectral-engineering
Organization: National Aeronautics and Space Administration
Damage Propagation Modeling for Aircraft Engine Run-to-Failure Simulation

This paper describes how damage propagation can be modeled within the modules of aircraft gas turbine engines. To that end, response surfaces of all sensors are generated via a thermo-dynamical simulation model for the engine as a function of variations of flow and efficiency of the modules of interest. An exponential rate of change for flow and efficiency loss was imposed for each data set, starting at a randomly chosen initial deterioration set point. The rate of change of the flow and efficiency denotes an otherwise unspecified fault with increasingly worsening effect. The rates of change of the faults were constrained to an upper threshold but were otherwise chosen randomly. Damage propagation was allowed to continue until a failure criterion was reached. A health index was defined as the minimum of several superimposed operational margins at any given time instant and the failure criterion is reached when health index reaches zero. Output of the model was the time series (cycles) of sensed measurements typically available from aircraft gas turbine engines. The data generated were used as challenge data for the Prognostics and Health Management (PHM) data competition at PHM’08.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Mariana

The Mariana source code has been open sourced.  Download the tar file Mariana.tgz below.  I would love feedback.

 

Mariana is an auto-classifier algorithm that efficiently optimizes hyperparameters for Support Vector Machines.

Mariana is an algorithm that efficiently optimizes the hyperparameters for Support Vector Machines for regression and classification.  It currently uses Simulated Annealing for optimization but can be extended to use a variety of stochastic optimization techniques including, Markov Chain Monte Carlo, Sequential Monte Carlo, and Genetic Algorithms. Mariana can be applied to the text portion of reports, determining the likely categories that each report falls into, and calculating a confidence for each classification. Mariana¹s innovation is it automates the search for the optimum hyperparameters.  It does so by randomly selecting a set of hyperparameters.  Next it builds a model from the training data and tests the model's performance using the validation set.  That performance is compared to previous performances, and if the current set of hyperparameters are better than the previous one, then it records the hyperparameters.  This process is repeated until there are no noticeable improvements in performance or at a predefined stopping point.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Black Hole - Neutron Star Binary Mergers

Gravitational radiation waveforms for black hole-neutron star coalescence calculations. The physical input is Newtonian physics, an ideal gas equation of state with varying compressibility (through the index gamma), and point-mass gravitational radiation back reaction, which is switched off in the simulation once the star is tidally disrupted. All the simulations are 3D, done using SPH.

Tags: astronomy, binary, black-hole, gravitational-waves, ligo, neutron-stars, space-science
Organization: National Aeronautics and Space Administration
SMAP_L1B_SIGMA_NAUGHT_LOW_RES_V003

SMAP Level 1B Sigma Naught Low Res Product Version 3

Tags: active-remote-sensing, earth-observation-satellites, earth-remote-sensing-instruments, earth-science, imaging-radars, nasa-decadal-survey, platform-characteristics, radar, smap, spectral-engineering
Organization: National Aeronautics and Space Administration
SBUV2/NOAA-9 Level 2 Daily Ozone Profile and Total Column from CD-ROM V008 (SBUV2N09O3) at GES DISC

The version 8 SBUV/2 NOAA-9 ozone data were first released at the 2004 Quadrennial Ozone Symposium on DVD. The DVD contained all of the SBUV/2 data from NOAA-9, NOAA-11 and NOAA-16 satellites as well as SBUV data from the Nimbus-7 satellite. The DVD is no longer available, however all the data are available on-line from the NASA GES DISC. The NOAA-9 SBUV/2 v8 data are available in two time periods from 1985-02-02 to 1989-12-31 (ascending orbits) and again from 1992-01-01 to 1998-02-19 (descending orbits) due to the drift of the NOAA-9 satellite. The instrument spatial resolution is 180 km x 180 km footprint at nadir. The ozone profiles are made at 21 pressure levels between 1000 and 0.1 hPa. Each data file contains a days worth of ozone measurements, and is written in an ASCII text format.

The SBUV/2 is a scanning double monochromator and a cloud cover radiometer (CCR) designed to measure ultraviolet (UV) spectral intensities. In its primary mode of operation, the monochromator measures solar radiation backscattered by the atmosphere in 12 discrete wavelength bands in the near-UV, ranging from 252.0 to 339.8 nanometers, each with a bandpass of 1.1 nm. The total-ozone algorithm uses the four longest wavelength bands (312.5, 317.5, 331.2 and 339.8 nm), whereas the profiling algorithm uses the shorter wavelengths. The cloud cover radiometer operates at 379 nm (i.e., outside the ozone absorption band) with a 3.0 nm bandpass and was designed to measure the reflectivity of the surface in the IFOV. The SBUV/2 also makes periodic measurements of the solar flux by deploying a diffuser plate into the FOV to reflect sunlight into the measurement.

Tags: aerosols, atmosphere, atmospheric-chemistry, atmospheric-radiation, earth-science
Organization: National Aeronautics and Space Administration
STI Tagging Models

Keyword models for a subset of the NASA Thesaurus (https://www.sti.nasa.gov/nasa-thesaurus/). These models were trained on the NASA Technical Reports Server (NTRS). These models can be used with the concept-tagging-api flask server (https://github.com/nasa/concept-tagging-api) to run a keyword predicting service.

Tags: information-retrieval, keyword-tagging, machine-learning, metadata-management, natural-language-processing, ntrs, sti, usg-artificial-intelligence
Organization: National Aeronautics and Space Administration
GOES-R PLT Colorado Lightning Mapping Array (LMA) V1

The GOES-R PLT Colorado Lightning Mapping Array (LMA) dataset consists of total lightning data measured from the Colorado LMA (COLMA) network during the GOES-R Post Launch Test (PLT) airborne science field campaign. The GOES-R PLT airborne science field campaign took place in support of the post-launch product validation of the Advanced Baseline Imager (ABI) and the Geostationary Lightning Mapper (GLM). The LMA measures the arrival time of radiation from a lightning discharge at multiple stations and locates the sources of radiation to produce a three-dimensional map of total lightning activity. These data files are available in compressed ASCII files and are available from March 1, 2017 through May 31, 2017.

Tags: atmosphere, atmospheric-electricity, earth-science
Organization: National Aeronautics and Space Administration
Discovering Anomalous Aviation Safety Events Using Scalable Data Mining Algorithms

The worldwide civilian aviation system is one of the most complex dynamical systems created. Most modern commercial aircraft have onboard flight data recorders that record several hundred discrete and continuous parameters at approximately 1Hz for the entire duration of the flight. These data contain information about the flight control systems, actuators, engines, landing gear, avionics, and pilot commands. In this paper, recent advances in the development of a novel knowledge discovery process consisting of a suite of data mining techniques for identifying precursors to aviation safety incidents are discussed. The data mining techniques include scalable multiple-kernel learning for large-scale distributed anomaly detection. A novel multivariate time-series search algorithm is used to search for signatures of discovered anomalies on massive datasets. The process can identify operationally significant events due to environmental, mechanical, and human factors issues in the high-dimensional flight operations quality assurance data. All discovered anomalies are validated by a team of independent domain experts. This novel automated knowledge discovery process is aimed at complementing the state-of-the-art human-generated exceedance-based analysis that fails to discover previously unknown aviation safety incidents. In this paper, the discovery pipeline, the methods used, and some of the significant anomalies detected on real-world commercial aviation data are discussed.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Towards Accelerated Aging Methodologies and Health Management of Power MOSFETs

Understanding aging mechanisms of electronic components is of extreme importance in the aerospace domain where they are part of numerous critical subsystems including avionics. In particular, power MOSFETs are of special interest as they are involved in high voltage switching circuits such as drivers for electrical motors. With increased use of electronics in aircraft control, it becomes more important to understand the degradation of these components in aircraft specific environments. In this paper, we present an accelerated aging methodology for power MOSFETs that subject the devices to indirect thermal overstress during high voltage switching. During this accelerated aging process, two major modes of failure were observed – latch-up and die attach degradation. In this paper we present the details of our aging methodology along with details of experiments and analysis of the results.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
SENTINEL-1A_METADATA_RAW

Metadata for Sentinel-1A level zero product

Tags: agriculture, biosphere, coastal-processes, cryosphere, earth-science, erosion-sedimentation, forest-science, frozen-ground, geomorphic-landforms-processes, glaciers-ice-sheets, land-surface, land-use-land-cover, landscape, ocean-waves, ocean-winds, oceans, sea-ice, snow-ice, solid-earth, surface-water, tectonics, terrestrial-ecosystems, terrestrial-hydrosphere, topography
Organization: National Aeronautics and Space Administration
Prognostics Performance Evaluation

This is the first version of the performance evaluation tool. Evaluation is based on point estimates of the RUL predictions.

a more detailed documentation will be available with the tool soon.

in the meantime, please download the attached files/folder in the same root folder to run a demo. To evaluate your own results create results & application data files in .mat format and save in the results folder. please make sure you name your files as xxx_results.mat for results and yyy_appData.mat for application data.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
AIRS/Aqua L2 Near Real Time (NRT) Support Retrieval (AIRS-only) V006 (AIRS2SUP_NRT) at GES DISC

The Atmospheric Infrared Sounder (AIRS) Level 2 Near Real Time (NRT) Support Retrieval (AIRS-only) product (AIRS2SUP_NRT_006) differs from the routine product (AIRS2SUP_006) in four ways to meet the three hour latency requirements of the Land Atmosphere NRT Capability Earth Observing System (LANCE): (1) The NRT granules are produced without previous or subsequent granules if those granules are not available within 5 minutes, (2) the predictive ephemeris/attitude data are used rather than the definitive ephemeris/attitude, (3) if the forecast surface pressure is unavailable, a surface climatology is used, and (4) no ice cloud properties retrievals are performed. The consequences of these differences are described in the AIRS Near Real Time (NRT) data products document. The Atmospheric Infrared Sounder (AIRS) is a grating spectrometer (R = 1200) aboard the second Earth Observing System (EOS) polar-orbiting platform, EOS Aqua. In combination with the Advanced Microwave Sounding Unit (AMSU) and the Humidity Sounder for Brazil (HSB), AIRS constitutes an innovative atmospheric sounding group of visible, infrared, and microwave sensors. This product is product produced using AIRS IR only because the radiometric noise in AMSU channel 4 started to increase significantly (since June 2007). The Support Product includes higher vertical resolution profiles of the quantities found in the Standard Product, plus intermediate outputs (e.g., microwave-only retrieval), research products such as the abundance of trace gases, and detailed quality assessment information. The Support Product profiles contain 100 levels between 1100 and .016 mb; this higher resolution simplifies the generation of radiances using forward models, though the vertical information content is no greater than that in the Standard Product profiles. The intended users of the Support Product are researchers interested in generating forward radiance or in examining research products, and the AIRS algorithm development team. The Support Product is generated at all locations as Standard Products. An AIRS granule has been set as 6 minutes of data, 30 footprints cross track by 45 scanlines. There are 240 granules per day, with an orbit repeat cycle of approximately 16 day.

Tags: aerosols, air-quality, altitude, atmosphere, atmospheric-chemistry, atmospheric-pressure, atmospheric-radiation, atmospheric-temperature, atmospheric-water-vapor, clouds, earth-science, land-surface, ocean-temperature, oceans, precipitation, surface-radiative-properties, surface-thermal-properties
Organization: National Aeronautics and Space Administration