AndreaBozzo/ceres-open-data-index huggingface dataset:
SPATIALLY ADAPTIVE SEMI-SUPERVISED LEARNING WITH GAUSSIAN PROCESSES FOR HYPERSPECTRAL DATA ANALYSIS

SPATIALLY ADAPTIVE SEMI-SUPERVISED LEARNING WITH GAUSSIAN
PROCESSES FOR HYPERSPECTRAL DATA ANALYSIS
GOO JUN * AND JOYDEEP GHOSH*


Abstract. A semi-supervised learning algorithm for the classification of hyperspectral data,
Gaussian process expectation maximization (GP-EM), is proposed. Model parameters for each
land cover class is first estimated by a supervised algorithm using Gaussian process regressions
to find spatially adaptive parameters, and the estimated parameters are then used to initialize a
spatially adaptive mixture-of-Gaussians model. The mixture model is updated by expectationmaximization
iterations using the unlabeled data, and the spatially adaptive parameters for unlabeled
instances are obtained by Gaussian process regressions with soft assignments. Two sets
of hyperspectral data taken from the Botswana area by the NASA EO-1 satellite are used for experiments.
Empirical evaluations show that the proposed framework performs significantly better
than baseline algorithms that do not use spatial information, and the results are also better than
any previously reported results by other algorithms on the same data.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
LAT Data Server

Fermi is a powerful space observatory that will open a wide window on the universe. Gamma rays are the highest-energy form of light, and the gamma-ray sky is spectacularly different from the one we perceive with our own eyes. With a huge leap in all key capabilities, Fermi data will enable scientists to answer persistent questions across a broad range of topics, including supermassive black-hole systems, pulsars, the origin of cosmic rays, and searches for signals of new physics.

Tags: astrophysics, gamma-ray-bursts, gbm, lat, light-arcs, particle-physics, photons, pulsars, solar-flares, space-science
Organization: National Aeronautics and Space Administration
National Land Cover Data set 1992 (NLCD1992)

National Land Cover Dataset 1992 (NLCD1992) is a 21-class land cover classification scheme that has been applied consistently across the lower 48 United States at a spatial resolution of 30 meters. NLCD92 is based primarily on the unsupervised classification of Landsat Thematic Mapper (TM) circa 1990's satellite data. Other ancillary data sources used to generate these data included topography, census, and agricultural statistics, soil characteristics, and other types of land cover and wetland maps. NLCD1992 is the only NLCD dataset that can be downloaded by state and by user defined area from the MRLC Consortium Viewer.

Tags: earth-science, land-surface, surface-radiative-properties, topography
Organization: National Aeronautics and Space Administration
NLCD 2001 Version 2

National Land Cover Database 2001 (NLCD2001) is a 16-class (additional four classes in Alaska only) land cover classification scheme that has been applied consistently across all 50 United States and Puerto Rico at a spatial resolution of 30 meters. NLCD2001 is based primarily on the unsupervised classification of Landsat Enhanced Thematic Mapper+ (ETM+) circa 2001 satellite data. NLCD2001 improves on NLCD92 in that it is comprised of three different elements: land cover, percent developed impervious surface and percent tree canopy density. NLCD2001 also uses improved classification algorithms, which have resulted in data with more precise rending of spatial boundaries between the land cover classes.

Tags: earth-science, erosion-sedimentation, geomorphic-landforms-processes, land-surface, land-use-land-cover, landscape, soils, surface-radiative-properties, topography
Organization: National Aeronautics and Space Administration
High Energy Laboratory Astrophysics using an X-Ray Microcalorimeter with an Electron Beam Ion Trap Project

"Since the summer of 2000 we have successfully deployed a high resolution x-ray microcalorimeter spectrometer, based on the spaceflight XRS instrument, at the Electron Beam Ion Trap (EBIT) facility at the Lawrence Livermore National Laboratory. Over the last decade, this highly successful partnership has made fundamental measurements in laboratory astrophysics including the measurements of the absolute cross sections of all the Fe L shell transitions from Fe XVII to Fe XXIV, line ratios in Fe and Ni L shell transitions, measurements of Fe K shell emission over a wide range of electron energies, and direct measurements of charge exchange emission from highly ionized Fe, O, N, and most recently L shell S, using a variety of donor gases. This work has resulted in the publication of over 30 peer-reviewed articles with many more either submitted or in preparation. The newest addition to the facility, the ECS microcalorimeter spectrometer, developed under this program, has performed flawlessly as a facility-class instrument since 2007.



We propose here to continue our highly successful partnership and deploy new technology to resolve lines in the important 1/4 keV band that encompasses the M-shell iron emission and the L shell emission, including charge exchange, of many of the lower-Z elements, such as Si, S, Mg, Ne, Ca, and Ar. We thus propose completing a new spectrometer that will bring substantially improved performance to the laboratory astrophysics program at EBIT and will enable fundamentally new measurements. Thus, in addition to maintaining the current spectrometers, which will begin this work, a significant component of this proposal is the completion of a new spectrometer leveraged off of the substantial progress in high-resolution x-ray detectors developed for the International X-ray Observatory mission. The spectrometer will be composed of a detector system with unparalleled spectral resolution: 2 eV resolution across the 0.05-10 keV band. This will allow

Tags: active, goddard-space-flight-center, project
Organization: National Aeronautics and Space Administration
Greener Aviation with Virtual Sensors:  A Case Study

The environmental impact of aviation is enormous given the fact that
in the US alone there are nearly 6 million flights per year of commercial aircraft.
This situation has driven numerous policy and procedural measures to help develop
environmentally friendly technologies which are safe and affordable and reduce the
environmental impact of aviation. However, many of these technologies require significant
initial investment in newer aircraft fleets and modifications to existing regulations
which are both long and costly enterprises. We propose to use an anomaly
detection method based on Virtual Sensors to help detect overconsumption of fuel in
aircraft which relies only on the data recorded during flight of most existing commercial
aircraft, thus significantly reducing the cost and complexity of implementing this
method. The Virtual Sensors developed here are ensemble-learning regression models
for detecting the overconsumption of fuel based on instantaneous measurements
of the aircraft state. This approach requires no additional information about standard
operating procedures or other encoded domain knowledge. We present experimental
results on three data sets and compare five different Virtual Sensors algorithms. The
first two data sets are publicly available and consist of a simulated data set from a
flight simulator and a real-world turbine disk.We show the ability to detect anomalies
with high accuracy on these data sets. These sets contain seeded faults, meaning that
they have been deliberately injected into the system. The second data set is from realworld
fleet of 84 jet aircraft where we show the ability to detect fuel overconsumption
which can have a significant environmental and economic impact. To the best of our
knowledge, this is the first study of its kind in the aviation domain.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
National High Altitude Photography

The National High Altitude Photography (NHAP) program, which was operated from 1980 - 1989, was coordinated by the U.S. Geological Survey as an interagency project to eliminate duplicate photography in various Government programs.  The aim of the program was to cover the 48 conterminous states of the USA over a 5-year span.  In the NHAP program, black-and-white and color-infrared aerial photographs were obtained on 9-inch film from an altitude of 40,000 feet above mean terrain elevation and are centered over USGS 7.5-minute quadrangles.  The color-infrared photographs are at a scale of 1:58,000 (1 inch equals about .9 miles) and the black-and-white photographs are at a scale of 1:80,000 (1 inch equals about 1.26 miles).

Tags: earth-science, land-surface, spectral-engineering, surface-radiative-properties, topography, visible-wavelengths
Organization: National Aeronautics and Space Administration
SWOT Level 2 Nadir Altimeter Operational Geophysical Data Record with Waveforms - SSHA, Version 2.0

Same as L2_NALT_GDR using predicted values for some auxiliary data, and does not have GIM ionosphere model values. Uses the onboard DORIS orbit ephemeris. Available with latency of < 7 hours. Discrete measurements at nadir for each data downlink, along the ground track. Available in netCDF-4 file format.

Tags: earth-science, ocean-waves, oceans, sea-surface-topography
Organization: National Aeronautics and Space Administration
Satellite Laser Ranging Satellite Orbit Product from NASA CDDIS

SLR Satellite Orbit solutions available from the Crustal Dynamics Data Information System (CDDIS). Precise Orbit Determination (POD) solutions in Standard Product 3 (SP3) format derived from analysis of Satellite Laser Ranging (SLR) data. These products are the generated by analysis centers in support of the International Laser Ranging Service (ILRS) and combined by the ILRS analysis coordinator to form the official ILRS orbit product (weekly), available approximately 5 days after the end of the solution week.

Tags: earth-science, geodetics, gravity-gravitational-field, solid-earth, tectonics
Organization: National Aeronautics and Space Administration
GOES-R PLT Geostationary Coastal and Air Pollution Event (GEO-CAPE) Airborne Simulator (GCAS) V1

The GOES-R PLT Geostationary Coastal and Air Pollution Event (GEO-CAPE) Airborne Simulator (GCAS) dataset consist of solar backscattered radiation measured by the Geostationary Coastal and Air Pollution Event (GEO-CAPE) Airborne Simulator (GCAS) flown aboard a NASA ER-2 high-altitude aircraft during the GOES-R Post Launch Test (PLT) field campaign. The GOES-R PLT field campaign took place from March to May of 2017 in support of post-launch L1B product validation of the Advanced Baseline Image (ABI) and the Geostationary Lightning Mapper (GLM). Data files in HDF-5 format are available for March 21, 2017 through May 14, 2017.

Tags: atmosphere, earth-science, ocean-optics, oceans, weather-events
Organization: National Aeronautics and Space Administration
CDDIS_GNSS_products_orbit_realtime

Precise satellite orbits derived from analysis of Global Navigation Satellite System (GNSS) data. Analysis Centers (ACs) of the International GNSS Service (IGS) retrieve GNSS data on regular schedules to produce precise orbits identifying the position and velocity of the GNSS satellites. The orbits derived from real-time data streams are used for comparison purposes.

Tags: nasa
Organization: National Aeronautics and Space Administration
GLAS/ICESat L2 Global Antarctic and Greenland Ice Sheet Altimetry Data (HDF5) V034

GLAH06 is used in conjunction with GLAH05 to create the Level-2 altimetry products. Level-2 altimetry data provide surface elevations for ice sheets (GLAH12), sea ice (GLAH13), land (GLAH14), and oceans (GLAH15). Data also include the laser footprint geolocation and reflectance, as well as geodetic, instrument, and atmospheric corrections for range measurements. The Level-2 elevation products, are regional products archived at 14 orbits per granule, starting and stopping at the same demarcation (± 50° latitude) as GLAH05 and GLAH06. Each regional product is processed with algorithms specific to that surface type. Surface type masks define which data are written to each of the products. If any data within a given record fall within a specific mask, the entire record is written to the product. Masks can overlap: for example, non-land data in the sea ice region may be written to the sea ice and ocean products. This means that an algorithm may write the same data to more than one Level-2 product. In this case, different algorithms calculate the elevations in their respective products. The surface type masks are versioned and archived at NSIDC, so users can tell which data to expect in each product.  Each data granule has an associated browse product.

Tags: cryosphere, earth-science, glaciers-ice-sheets, sea-ice, terrestrial-hydrosphere
Organization: National Aeronautics and Space Administration
ICESat-2 Derived Sea Ice Melt Pond Characteristics from the Density-Dimension Algorithm V003

This data set provides locations and depths of melt ponds in the Multi-Year Arctic Sea Ice Region, calculated from ATLAS/ICESat-2 L2A Global Geolocated Photon Data, Version 5 (ATL03) using an autoadaptive algorithm.

Tags: cryosphere, earth-science, sea-ice
Organization: National Aeronautics and Space Administration
Advances in Uncertainty Representation and Management for Particle Filtering Applied to Prognostics

Particle filters (PF) have been established as the de facto state of the art
in failure prognosis. They combine advantages of the rigors of Bayesian estimation
to nonlinear prediction while also providing uncertainty estimates with a given solution. Within the context of particle filters, this paper introduces several novel methods for uncertainty representations and uncertainty management. The prediction uncertainty is modeled via a rescaled Epanechnikov kernel and is assisted with resampling techniques and regularization algorithms. Uncertainty management is accomplished through parametric adjustments in a feedback correction loop of the state model and its noise distributions. The correction loop provides the mechanism to incorporate information that can improve solution accuracy and reduce uncertainty bounds. In addition, this approach results in reduction in computational burden. The scheme is illustrated with real vibration feature data from a fatigue-driven fault in a critical aircraft component.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Convergent Aeronautics Solutions Project

&lt;p&gt;The Convergent Aeronautics Solutions (CAS) Project uses short-duration activities to establish early-stage concept and technology feasibility for high-potential solutions. Internal teams propose ideas for overcoming key barriers associated with large-scale aeronautics problems associated with ARMD&amp;rsquo;s six strategic thrusts. The teams will conduct initial feasibility studies, perform experiments, try out new ideas, identify failures, and try again. At the end of the cycle, a review determines whether the developed solutions have met their goals, established initial feasibility, and identified potential for future aviation impact. During these reviews, the most promising capabilities will be considered for continued development further by other ARMD programs or by direct transfer to the aviation community. In the dynamic environment of new ideas, ARMD also gains significant value from the knowledge gained in activities that do not proceed.&lt;/p&gt;&lt;p&gt;In order to enable new capabilities in commercial aviation, the CAS Project&amp;rsquo;s focus is on merging traditional aeronautics disciplines with advancements driven by the non-aeronautics world.&amp;nbsp; The Project will draw on external collaborators to supplement in-house NASA expertise in technologies and disciplines that broadly support advancements in all ARMD strategic thrusts.&lt;/p&gt;

Tags: active, cas, nasa-headquarters, project
Organization: National Aeronautics and Space Administration
DXC'11 Industrial Track Competition Data

Competition data, including nominal and faulty scenarios, for Diagnostic Problem I of the Third International Diagnostic Competition. Three file formats are provided, tab-delimited .txt files, Matlab .mat files, and tab-delimited .scn files. The scenario (.scn) files are read by the DXC framework. See the DXC'11 Industrial Track Sample Data resource page for additional documentation, including system catalogs and schematics. There were no DA entries for Diagnostic Problem II so we are withholding the data for use in a future Diagnostic Competition.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Fleet Level Anomaly Detection of Aviation Safety Data

For the purposes of this paper, the National
Airspace System (NAS) encompasses the operations of all
aircraft which are subject to air traffic control procedures.
The NAS is a highly complex dynamic system that is
sensitive to aeronautical decision-making and risk management
skills. In order to ensure a healthy system with safe
flights a systematic approach to anomaly detection is very
important when evaluating a given set of circumstances
and for determination of the best possible course of action.
Given the fact that the NAS is a vast and loosely integrated
network of systems, it requires improved safety assurance
capabilities to maintain an extremely low accident rate
under increasingly dense operating conditions. Data mining
based tools and techniques are required to support and aid
operators’ (such as pilots, management, or policy makers)
overall decision-making capacity. Within the NAS, the
ability to analyze fleetwide aircraft data autonomously is
still considered a significantly challenging task. For our
purposes a fleet is defined as a group of aircraft sharing
generally compatible parameter lists. Here, in this effort,
we aim at developing a system level analysis scheme. In this
paper we address the capability for detection of fleetwide
anomalies as they occur, which itself is an important
initiative toward the safety of the real-world flight operations.
The flight data recorders archive millions of data
points with valuable information on flights everyday. The
operational parameters consist of both continuous and discrete
(binary & categorical) data from several critical subsystems
and numerous complex procedures. In this paper,
we discuss a system level anomaly detection approach based
on the theory of kernel learning to detect potential safety
anomalies in a very large data base of commercial aircraft.
We also demonstrate that the proposed approach uncovers
some operationally significant events due to environmental,
mechanical, and human factors issues in high dimensional,
multivariate Flight Operations Quality Assurance (FOQA)
data. We present the results of our detection algorithms on
real FOQA data from a regional carrier.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
GOES-R PLT Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) V1

The GOES-R PLT Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) dataset consists of radiance, reflectance, water phase, and navigation data delivered by the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) flown aboard the NASA ER-2 high-altitude aircraft during the GOES-R PLT field campaign. This field campaign took place from March through May 2017 in support of post-launch L1B and L2+ product validation of the Advanced Baseline Imager (ABI) and the Geostationary Lightning Mapper (GLM) satellite instruments. The GOES-R PLT AVIRIS data files are available from April 11, 2017 through May 14, 2017 in ASCII and binary formats along with browse imagery files in JPG format.

Tags: earth-science, infrared-wavelengths, spectral-engineering, visible-wavelengths
Organization: National Aeronautics and Space Administration
AIRS/Aqua L1B Near Real Time (NRT) Visible/Near Infrared (VIS/NIR) quality assurance subset V005 (AIRVBQAP_NRT) at GES DISC

The AIRS Level 1B Near Real Time (NRT) product (AIRVBQAP_NRT_005) differs from the routine product (AIRVBQAP_005) in 2 ways to meet the three hour latency requirements of the Land Atmosphere NRT Capability Earth Observing System (LANCE): (1) The NRT granules are produced without previous or subsequent granules if those granules are not available within 5 minutes, (2) the predictive ephemeris/attitude data are used rather than the definitive ephemeris/attitude. The consequences of these differences are described in the AIRS Near Real Time (NRT) data products document. The Atmospheric Infrared Sounder (AIRS) Visible/Near Infrared (VIS/NIR) instrument in combination with the AIRS Infrared Spectrometer, the Advanced Microwave Sounding Unit (AMSU) and the Humidity Sounder for Brazil (HSB) constitute an innovative atmospheric sounding group aboard the Earth Observing System (EOS) Aqua platform in a near-polar Sun-synchronous orbit with a 1:30 AM/PM equator crossing time and an ~705 km altitude. The AIRS Visible/Near Infrared (VIS/NIR) Level 1B QA Subset contains Quality Assurance (QA) parameters that a may use of filter AIRS VIS/NIR Level 1B radiance data to create a subset of analysis. It includes "state" that user should check before using any VIS/NIR Level 1B data radiance and "glintlat", "glintlon", and "sun_glint_distant" that users can use to check for possibility of solar glint contamination. AIRS VIS/NIR Level 1B radiance data can be found in AIRVBRAD.

Tags: earth-science, infrared-wavelengths, spectral-engineering, visible-wavelengths
Organization: National Aeronautics and Space Administration
GOES-R PLT Cloud Radar System (CRS) V1

The GOES-R PLT Field Campaign Cloud Radar System (CRS) dataset provides high-resolution profiles of reflectivity and Doppler velocity at aircraft nadir along the flight track. The CRS was flown aboard a NASA ER-2 high-altitude aircraft during the GOES-R Post Launch Test (PLT) field campaign. The GOES-R PLT field campaign took place from March 21 to May 17, 2017 in support of post-launch product validation of the Advanced Baseline Image (ABI) and the Geostationary Lightning Mapper (GLM) aboard the GOES-R, now GOES-16, satellite. The CRS data files are available in netCDF-3 format with browse imagery available in PNG format.

Tags: earth-science, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
TROPICS03 L1A Orbital Geolocated Native-Resolution Antenna Temperatures V1.0

The "Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats" (TROPICS) mission has a goal of providing nearly all-weather observations of three-dimensional temperature and humidity, as well as cloud ice and precipitation horizontal structure, at high temporal resolution to conduct high-value science investigations of tropical cyclones.  The mission comprises a constellation of six identical Space Vehicles (SVs) conforming to the 3U form factor and hosting a passive microwave spectrometer payload.  This dataset is produced from the Pathfinder satellite, a single 3U small satellite, which has launched previous to the constellation, on a sun-synchronous orbital plane.

Each SV hosts an identical high-performance spectrometer named the TROPICS Millimeter-wave Sounder (TMS) that will provide temperature profiles using seven channels near the 118.75-GHz oxygen absorption line, water vapor profiles using three channels near the 183-GHz water vapor absorption line, imagery in a single channel near 90 GHz for precipitation measurements (when combined with higher resolution water vapor channels), and a single channel near 205 GHz that is more sensitive to cloud-sized ice particles.

Each TROPICS netCDF file contains a granule of data with 81 spots and approximately 2880 scans, where a granule is defined as an orbit's worth of data.

Tags: earth-science, microwave, spectral-engineering
Organization: National Aeronautics and Space Administration