AndreaBozzo/ceres-open-data-index huggingface dataset:
AMSU/MSU Lowstratosphere Day/Month Temperature Anomalies and Annual Cycle V6

The AMSU/MSU Lowstratosphere Day/Month Temperature Anomalies and Annual Cycle V6 dataset consists of temperature anomalies and annual cycle temperatures derived from the Microwave Sounding Unit (MSU) and the Advanced Microwave Sounding Unit-A (AMSU-A) radiance data since January 1978. All products are derived for the lower stratosphere. The dataset begins on January 1, 1978 and is still currently ongoing. The data are available in netCDF-4 and ASCII formats.

Tags: atmosphere, atmospheric-temperature, earth-science
Organization: National Aeronautics and Space Administration
DC-8 Meteorological and Navigation Data CPEX-AW V1

The DC-8 Meteorological and Navigation Data CPEX-AW dataset is a subset of airborne measurements that include GPS positioning and trajectory data, aircraft orientation, and atmospheric state measurements of temperature, pressure, water vapor, and horizontal winds. These measurements were taken from the NASA DC-8 aircraft during the Convective Processes Experiment – Aerosols & Winds (CPEX-AW) field campaign. CPEX-AW was a joint effort between the US National Aeronautics and Space Administration (NASA) and the European Space Agency (ESA) with the primary goal of conducting a post-launch calibration and validation activities of the Atmospheric Dynamics Mission-Aeolus (ADM-AEOLUS) Earth observation wind Lidar satellite in St. Croix, U.S. Virgin Islands. Data are available from August 17, 2021 through September 4, 2021 in ASCII format.

Tags: atmosphere, atmospheric-pressure, atmospheric-temperature, atmospheric-water-vapor, atmospheric-winds, earth-science, platform-characteristics, spectral-engineering
Organization: National Aeronautics and Space Administration
NOAA-20 VIIRS Level-3 Global Mapped Triple-window Sea Surface Temperature (SST3) Data, version R2024.0

The Visible and Infrared Imager/Radiometer Suite (VIIRS) is a multi-disciplinary instrument that is being flown on the Joint Polar Satellite System (JPSS) series of spacecraft, including the Suomi National Polar-orbiting Partnership (S-NPP) that launched in October 2011. JPSS is a multi-platform, multi-agency program that consolidates the polar orbiting spacecraft of NASA and the National Oceanic and Atmospheric Administration (NOAA). S-NPP is the initial spacecraft in this series, and VIIRS is the successor to MODIS for Earth science data product generation. VIIRS has 22 spectral bands ranging from 412 nm to 12 nm. There are 16 moderate-resolution bands (750m at nadir), 5 image-resolution bands (375m), and one day-night band (DNB).

Tags: earth-science, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
SMAP_L1A_RADAR_RECEIVE_ONLY_METADATA_V003

SMAP Level 1A Radar Receive Only Product Metadata Version 3

Tags: active-remote-sensing, earth-observation-satellites, earth-remote-sensing-instruments, earth-science, imaging-radars, nasa-decadal-survey, platform-characteristics, radar, smap, spectral-engineering
Organization: National Aeronautics and Space Administration
Data from Sustainability Base Characterizing Cold Complaints for ACCEPT

The zip file linked contains three subdirectories and a parameter list to be used for processing using ACCEPT. Datafiles are partitioned into training, validation, and testing sub-directory structures. A text file contains all parameter identifiers associated with the cold complaint prediction scenario. Please note that the parameter list is a text file containing the following lines:

DC114T - Electrical room temperature
DCRCS103 - Carbon Dioxide concentration sensor in first floor conference room
DCTN240T - Second floor conference room temperature

Please note that Appendix E of an accompanying technical report will be posted here shortly, which will provide more detail on the cold complaint scenario, along with step-by-step directions on how to reproduce the results for this example using ACCEPT. Other appendices will provide detailed set up and configuration instructions.

Here is the citation:

Rodney Martin, Santanu Das, Vijay Janakiraman, Stefan Hosein. ACCEPT: Introduction of the Adverse Condition and Critical Event Prediction Toolbox, NASA Technical Report, NASA/TM–2015– 218927, November 2015.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Declassified Satellite Imagery 2 (2002)

Declassified satellite images provide an important worldwide record of land-surface change. With the success of the first release of classified satellite photography in 1995, images from U.S. military intelligence satellites KH-7 and KH-9 were declassified in accordance with Executive Order 12951 in 2002. The data were originally used for cartographic information and reconnaissance for U.S. intelligence agencies. Since the images could be of historical value for global change research and were no longer critical to national security, the collection was made available to the public.

Keyhole (KH) satellite systems KH-7 and KH-9 acquired photographs of the Earth’s surface with a telescopic camera system and transported the exposed film through the use of recovery capsules. The capsules or buckets were de-orbited and retrieved by aircraft while the capsules parachuted to earth. The exposed film was developed and the images were analyzed for a range of military applications.

The KH-7 surveillance system was a high resolution imaging system that was operational from July 1963 to June 1967. Approximately 18,000 black-and-white images and 230 color images are available from the 38 missions flown during this program. Key features for this program were larger area of coverage and improved ground resolution. The cameras acquired imagery in continuous lengthwise sweeps of the terrain. KH-7 images are 9 inches wide, vary in length from 4 inches to 500 feet long, and have a resolution of 2 to 4 feet.

The KH-9 mapping program was operational from March 1973 to October 1980 and was designed to support mapping requirements and exact positioning of geographical points for the military. This was accomplished by using image overlap for stereo coverage and by using a camera system with a reseau grid to correct image distortion. The KH-9 framing cameras produced 9 x 18 inch imagery at a resolution of 20-30 feet. Approximately 29,000 mapping images were acquired from 12 missions. 

The original film sources are maintained by the National Archives and Records Administration (NARA). Duplicate film sources held in the USGS EROS Center archive are used to produce digital copies of the imagery.

Tags: earth-science, land-surface, surface-radiative-properties, topography
Organization: National Aeronautics and Space Administration
Gazetteer of Planetary Nomenclature: Saturnian System: Enceladus

These images display several of Saturn's moons approved by the International Astronomical Union (IAU).

Tags: dione, enceladus, epimetheus, hyperion, iapetus, imagery, images, janus, mimas, moons, phoebe, rhea, saturn, tethys, titan, usgs, working-group-for-planetary-system-nomenclature
Organization: National Aeronautics and Space Administration
Comparison of Unsupervised Anomaly Detection Methods

Several different unsupervised anomaly detection algorithms have been applied to Space Shuttle Main Engine (SSME) data to serve the purpose of developing a comprehensive suite of Integrated Systems Health Management (ISHM) tools. As the theoretical bases for these methods vary considerably, it is reasonable to conjecture that the resulting anomalies detected by them may differ quite significantly as well. As such, it would be useful to apply a common metric with which to compare the results. However, for such a quantitative analysis to be statistically significant, a sufficient number of examples of both nominally categorized and anomalous data must be available. Due to the lack of sufficient examples of anomalous data, use of any statistics that rely upon a statistically significant sample of anomalous data is infeasible. Therefore, the main focus of this paper will be to compare actual examples of anomalies detected by the algorithms via the sensors in which they appear, as well the times at which they appear. We find that there is enough overlap in detection of the anomalies among all of the different algorithms tested in order for them to corroborate the severity of these anomalies. In certain cases, the severity of these anomalies is supported by their categorization as failures by experts, with realistic physical explanations. For those anomalies that can not be corroborated by at least one other method, this overlap says less about the severity of the anomaly, and more about their technical nuances, which will also be discussed.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
VIIRS/NPP Snow Cover Daily L3 Global 375m SIN Grid V002

This data set contains daily snow cover derived from radiance data acquired by the Visible Infrared Imaging Radiometer Suite (VIIRS) on board the Suomi National Polar-orbiting Partnership (NPP) satellite. The data is a gridded composite, generated from 6 minute swaths, and projected to a 375 m Sinusoidal grid. Snow cover is identified using the Normalized Difference Snow Index (NDSI) and a series of screens designed to alleviate errors and flag uncertain snow cover detections.

Tags: cryosphere, earth-science, snow-ice
Organization: National Aeronautics and Space Administration
OCO-2 Level 1A collated, parsed, science or calibration data V11.2 (OCO2_L1aIn_Sample) at GES DISC

Version 11.2 is the current version of the data set. Older versions will no longer be available and are superseded by Version 11.2.

The Orbiting Carbon Observatory is the first NASA mission designed to collect space-based measurements of atmospheric carbon dioxide with the precision, resolution, and coverage needed to characterize the processes controlling its buildup in the atmosphere. The OCO-2 project uses the LEOStar-2 spacecraft that carries a single instrument. It incorporates three high-resolution spectrometers that make coincident measurements of reflected sunlight in the near-infrared CO2 near 1.61 and 2.06 micrometers and in molecular oxygen (O2) A-Band at 0.76 micrometers. The three spectrometers have different characteristics and are calibrated independently. Their raw data numbers (DN) are delivered correlated in time to the Level 1B process as Level 1A products. Each band has 1016 spectral elements, although some are masked out in the L2 retrieval.This product is the input to the Level 1B process. It is depacketized raw data formatted into a standard granularity with calibrated engineering data (for both science and calibration observations), in the Sample Mode of operation.

Tags: atmosphere, atmospheric-chemistry, earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
A Model-Based Prognostics Methodology For Electrolytic Capacitors Based On Electrical Overstress Accelerated Aging

A remaining useful life prediction methodology for electrolytic capacitors is presented. This methodology is based on the Kalman filter framework and an empirical degradation model. Electrolytic capacitors are used in several applications ranging from power supplies on critical avionics equipment to power drivers for electro-mechanical actuators. These devices are known for their comparatively low reliability and given their criticality in electronics subsystems they are a good candidate for component level prognostics and health management. Prognostics provides a way to assess remaining useful life of a capacitor based on its current state of health and its anticipated future usage and operational conditions. We present here also, experimental results of an accelerated aging test under electrical stresses. The data obtained in this test form the basis for a remaining life prediction algorithm where a model of the degradation process is suggested. This preliminary remaining life prediction algorithm serves as a demonstration of how prognostics methodologies could be used for electrolytic capacitors. In addition, the use degradation progression data from accelerated aging, provides an avenue for validation of applications of the Kalman filter based prognostics methods typically used for remaining useful life predictions in other applications.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
CERES Clouds and Radiative Swath Aqua FM3 MODIS Edition2C

CER_CRS_Aqua-FM3-MODIS_Edition2c is the Clouds and the Earth's Radiant Energy System (CERES) Clouds and Radiative Swath (CRS) Aqua-Flight Model 3 (FM3) Moderate-Resolution Imaging Spectroradiometer (MODIS) Edition2C data product, which was collected using the CERES-FM3 instrument on the Aqua platform. Data collection for this product is complete. Note that more recent (2006) CRS Ed2C fields for untuned SW (upper left for all-sky globe and lower right for clear-sky ocean) show a bit more bias than does an average of the earlier (2002-2005) Clouds and Radiative Swath (CRS) Ed2B. CRS Ed2C (Ed2B) biases are evaluated with respect to SSF Ed2C (Ed2B) observations, and those Single Scanner Footprint (SSF) observations do not include recent "Rev1" adjustments to observations.

The CRS product contains one hour of instantaneous Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The CRS contains all of the CERES SSF product data. For each CERES footprint on the SSF, the CRS also contains vertical flux profiles evaluated at four levels in the atmosphere: the surface, 500-, 70-, and 1-hPa. The CRS fluxes and cloud parameters are adjusted for consistency with a radiative transfer model and adjusted fluxes are evaluated at the four atmospheric levels for both clear-sky and total-sky.

CERES is a key component of the Earth Observing System (EOS) program. The CERES instruments provide radiometric measurements of the Earth's atmosphere from three broadband channels. The CERES missions are a follow-on to the successful Earth Radiation Budget Experiment (ERBE) mission. The first CERES instrument, protoflight model (PFM), was launched on November 27, 1997 as part of the Tropical Rainfall Measuring Mission (TRMM). Two CERES instruments (FM1 and FM2) were launched into polar orbit on board the Earth Observing System (EOS) flagship Terra on December 18, 1999. Two additional CERES instruments (FM3 and FM4) were launched on board Earth Observing System (EOS) Aqua on May 4, 2002. The CERES FM5 instrument was launched on board the Suomi National Polar-orbiting Partnership (NPP) satellite on October 28, 2011. The newest CERES instrument (FM6) was launched on board the Joint Polar-Orbiting Satellite System 1 (JPSS-1) satellite, now called NOAA-20, on November 18, 2017.

Tags: aerosols, atmosphere, atmospheric-radiation, atmospheric-temperature, atmospheric-water-vapor, atmospheric-winds, clouds, earth-science
Organization: National Aeronautics and Space Administration
TRMM TMI/PR Combined Precipitation L3 1 month 0.5 degree x 0.5 degree V7 (TRMM_3B31) at GES DISC

This is a combined rainfall product. 3B31 uses the high quality retrievals done for the narrow swath in 2B31 to calibrate the wide swath retrievals generated in 2A12. For each 0.5 degree box and each vertical layer, an adjustment ratio is calculated for the swath overlap region for one month. Only TMI pixels with 2A12 pixelStatus equal to zero are included in monthly averages, which effectively removes sea ice.

Tags: atmosphere, clouds, earth-science, precipitation
Organization: National Aeronautics and Space Administration
IceBridge UAF Lidar Scanner L1B Geolocated Surface Elevation Triplets V001

This data set contains scanning laser altimetry data points of Alaskan glaciers and parts of East and West Antarctica acquired by the airborne University of Alaska Fairbanks (UAF) Glacier Lidar system. The data were collected as part of NASA Operation IceBridge funded campaigns.

Tags: cryosphere, earth-science, glaciers-ice-sheets
Organization: National Aeronautics and Space Administration
Jason-1 SGDR version E NetCDF Geodetic

The Sensory Geophysical Data Record (SGDR) files from the Geodetic Mission contain full accuracy altimeter data, with a high precision orbit. The instruments on Jason-1 make direct observations of the following quantities: altimeter range, significant wave height, ocean radar backscatter cross-section (a measure of wind speed), ionospheric electron content (derived by a simple formula), tropospheric water content, mean sea surface, and position relative to the GPS satellite constellation. The SGDR contain all relevant corrections needed to calculate the sea surface height. It also contains the 20Hz waveforms that are required for retracking.  The SGDR is an expert level product, if you do not require the waveforms then the GDR will be more suited for your needs.

Tags: earth-science, ocean-waves, oceans, sea-surface-topography
Organization: National Aeronautics and Space Administration
Sentinel-3A OLCI Level-2 Earth-observation Reduced-Resolution (ERR) Inherent Optical Properties (IOP), Near Real-time (NRT) Data, version R2022.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: atmosphere, atmospheric-radiation, earth-science, ocean-optics, oceans
Organization: National Aeronautics and Space Administration
Circumpolar Flaw Lead System Study

Measurements taken within the Cape Bathurst flaw lead on board the icebreaker C.C.G.S. Amundsen to examine how physical changes affect biological processes in the flaw lead through an entire annual cycle (October 2007 - August 2008). The circumpolar flaw lead occurs each year when the central pack ice moves away from the coastal fast ice creating an area of open water called a flaw lead.

Tags: earth-science, ocean-chemistry, ocean-optics, ocean-temperature, oceans, salinity-density
Organization: National Aeronautics and Space Administration
SMAP_L1A_RADAR_RECEIVE_ONLY_QA_V001

SMAP Level 1A Radar Receive Only Data Quality Information Version 1

Tags: active-remote-sensing, earth-observation-satellites, earth-remote-sensing-instruments, earth-science, imaging-radars, nasa-decadal-survey, platform-characteristics, radar, smap, spectral-engineering
Organization: National Aeronautics and Space Administration
Gazetteer of Planetary Nomenclature: Venus: 1:10 million-scale Altimetry Quadrangles: Guinevere

This set of maps diplays altimetric radar images of Venus approved by the International Astronomical Union (IAU).

Tags: altimetry, imagery, images, planets, quadrangles, radar, usgs, venus, working-group-for-planetary-system-nomenclature
Organization: National Aeronautics and Space Administration
NASA 3D Models: Landsat 7

The Landsat Program is a series of Earth-observing satellite missions jointly managed by NASA and the U.S. Geological Survey. Since 1972, Landsat satellites have collected information about Earth from space.

Tags: 3d-model, eyes-on-the-earth-3d, eyes-on-the-solar-system, landsat7, satellite, spacecraft
Organization: National Aeronautics and Space Administration
Aqua MODIS Level-3 Global Binned 4µm Day/Night Sea Surface Temperature (SST4) - Near Real-time (NRT) Data, version R2019.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: earth-science, national-geospatial-data-asset, ngda, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
Privacy Preservation through Random Nonlinear Distortion

Consider a scenario in which the data owner has some private or sensitive data and wants a data miner to access them for studying important patterns without revealing the sensitive information. Privacy-preserving data mining aims to solve this problem by randomly transforming the data prior to their release to the data miners. Previous works only considered the case of linear data perturbations - additive, multiplicative, or a combination of both - for studying the usefulness of the perturbed output. In this paper, we discuss nonlinear data distortion using potentially nonlinear random data transformation and show how it can be useful for privacy-preserving anomaly detection from sensitive data sets. We develop bounds on the expected accuracy of the nonlinear distortion and also quantify privacy by using standard definitions. The highlight of this approach is to allow a user to control the amount of privacy by varying the degree of nonlinearity. We show how our general transformation can be used for anomaly detection in practice for two specific problem instances: a linear model and a popular nonlinear model using the sigmoid function. We also analyze the proposed nonlinear transformation in full generality and then show that, for specific cases, it is distance preserving. A main contribution of this paper is the discussion between the invertibility of a transformation and privacy preservation and the application of these techniques to outlier detection. The experiments conducted on real-life data sets demonstrate the effectiveness of the approach.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
AIRS/Aqua L2 CO2 in the free troposphere (AIRS-only) V005 (AIRS2STC) at GES DISC

The Atmospheric Infrared Sounder (AIRS) is a grating spectrometer (R = 1200) aboard the second Earth Observing System (EOS) polar-orbiting platform, EOS Aqua. In combination with the Advanced Microwave Sounding Unit (AMSU) and the Humidity Sounder for Brazil (HSB), AIRS constitutes an innovative atmospheric sounding group of visible, infrared, and microwave sensors. The AIRS Carbon Dioxide (CO2) Standard Retrieval Product consists of retrieved estimates of CO2, plus estimates of the errors associated with the retrieval. In contrast to AIRX2RET, the horizontal resolution of this standard product is about 110 km (1x1 degree). An AIRS granule has been set as 6 minutes of data, 15 footprints cross track by 22 lines along track.

Tags: atmosphere, atmospheric-chemistry, earth-science
Organization: National Aeronautics and Space Administration
ALOS_PALSAR_KMZ

ALOS PALSAR KMZ

Tags: agriculture, biosphere, coastal-processes, cryosphere, earth-science, erosion-sedimentation, forest-science, frozen-ground, geomorphic-landforms-processes, glaciers-ice-sheets, land-surface, land-use-land-cover, landscape, ocean-waves, ocean-winds, oceans, sea-ice, snow-ice, solid-earth, surface-water, tectonics, terrestrial-ecosystems, terrestrial-hydrosphere, topography
Organization: National Aeronautics and Space Administration