AndreaBozzo/ceres-open-data-index huggingface dataset:
TRMM Visible and Infrared Scanner Calibrated Radiances L1B 1.5 hours V7 (TRMM_1B01) at GES DISC

This TRMM Visible and Infrared Scanner (VIRS) Level 1B Calibrated Radiance Product (1B01) contains calibrated radiances and auxiliary geolocation information from the five channels of the VIRS instrument, for each pixel of each scan. The data are stored in the Hierarchical Data Format (HDF), which includes both core and product specific metadata applicable to the VIRS measurements. A file contains a single orbit of data with a file size of about 95 MB. The EOSDIS "swath" structure is used to accommodate the actual geophysical data arrays. There are 16 files of VIRS 1B01 data produced per day.

For channels 1 and 2, Level 1B radiances are derived from the Level 1A (1A01) sensor counts by computing calibration parameters (gain and offset) derived from the counts registered during space and solar and/or lunar views. New calibration parameters are produced every one to four weeks. Channels 3, 4, and 5 are calibrated using the internal blackbody and the space view. These calibration parameters, together with a quadratic term determined pre-launch, are used to generate a counts vs. radiance curve for each band, which is then used to convert the earth-view pixel counts to spectral radiances.

Geolocation and channel data are written out for each pixel along the scan, whereas the time stamp, scan status (containing scan quality information), navigation, calibration coefficients, and solar/satellite geometry are specified on a per-scan basis. There are in general 18026 scans along the orbit pre-boost and 18223 post-boost, with each scan consisting of 261 pixels. The scan width is about 720 km pre-boost and 833 km post-boost.

Changes in horizontal resolution resulting from the TRMM boost that occurred on 24 August 2001:

Pre-Boost (before 7 August 2001): Temporal Resolution: 91.5 min/orbit ~ 16 orbits/day; Swath Width: 720 km; Horizontal Resolution: 2.2 km 

Post-Boost (after 24 August 2001): Temporal Resolution: 92.5 min/orbit ~ 16 orbits/day; Swath Width: 833 km; Horizontal Resolution: 2.4 km

Tags: earth-science, infrared-wavelengths, platform-characteristics, sensor-characteristics, spectral-engineering, visible-wavelengths
Organization: National Aeronautics and Space Administration
NOAA-20 VIIRS Level-3 Global Binned Triple-window Sea Surface Temperature (SST3) Data, version R2024.0

The Visible and Infrared Imager/Radiometer Suite (VIIRS) is a multi-disciplinary instrument that is being flown on the Joint Polar Satellite System (JPSS) series of spacecraft, including the Suomi National Polar-orbiting Partnership (S-NPP) that launched in October 2011.  JPSS is a multi-platform, multi-agency program that consolidates the polar orbiting spacecraft of NASA and the National Oceanic and Atmospheric Administration (NOAA).  S-NPP is the initial spacecraft in this series, and VIIRS is the successor to MODIS for Earth science data product generation.  VIIRS has 22 spectral bands ranging from 412 nm to 12 nm.  There are 16 moderate-resolution bands (750m at nadir), 5 image-resolution bands (375m), and one day-night band (DNB).

Tags: earth-science, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
Cloud Radar System (CRS) IMPACTS V1

The Cloud Radar System (CRS) IMPACTS dataset consists of calibrated radar reflectivity, Doppler velocity, linear depolarization ratio, and normalized radar cross-section estimates collected by the Cloud Radar System (CRS) onboard the NASA ER-2 high-altitude research aircraft. These data were gathered during the Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) field campaign. IMPACTS was a three-year sequence of winter season deployments conducted to study snowstorms over the U.S Atlantic Coast (2020-2022). The campaign aimed to (1) Provide observations critical to understanding the mechanisms of snowband formation, organization, and evolution; (2) Examine how the microphysical characteristics and likely growth mechanisms of snow particles vary across snowbands; and (3) Improve snowfall remote sensing interpretation and modeling to significantly advance prediction capabilities. The CRS IMPACTS dataset files are available from January 25 through February 27, 2020 in HDF-5 format.

Tags: atmosphere, clouds, earth-science, precipitation, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
Jason-1 GDR SSHA version E NetCDF Geodetic

These Sea Surface Height Anomalies (SSHA) are derived from the Jason-1 Geophysical Data Record (GDR) Geodetic Mission. Jason-1 is an altimetric mission whose instruments make direct observations of the following quantities: altimeter range, significant wave height, ocean radar backscatter cross-section (a measure of wind speed), ionospheric electron content (derived by a simple formula), tropospheric water content, and position relative to the GPS satellite constellation.  Using the various parameter the SSHA can be calculated and are provided in this dataset.  The data are in NetCDF format.

Tags: earth-science, ocean-waves, oceans, sea-surface-topography
Organization: National Aeronautics and Space Administration
IceBridge Snow Radar L1B Geolocated Radar Echo Strength Profiles V002

This data set contains radar echograms taken from the Center for Remote Sensing of Ice Sheets (CReSIS) ultra wide-band snow radar over land and sea ice in the Arctic and Antarctic. In addition, airborne snow measurements were taken during 10 flights over Alaska mountains, ice fields, and glaciers at the end of May 2018 by a compact CReSIS FMCW radar system installed on a Single Otter aircraft. The data were collected as part of Operation IceBridge funded campaigns.

Tags: cryosphere, earth-science, glaciers-ice-sheets, oceans, radar, sea-ice, snow-ice, spectral-engineering, terrestrial-hydrosphere
Organization: National Aeronautics and Space Administration
Terra MODIS Level-3 Global Binned 4µm Day/Night Sea Surface Temperature (SST4) - Near Real-time (NRT) Data, version R2019.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: earth-science, national-geospatial-data-asset, ngda, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
TRMM Convective and Stratiform Heating L3 1 month 0.5 degree x 0.5 degree V6 (TRMM_CSH) at GES DISC

These data are output from the Goddard Convective-Stratiform Heating (CSH) algorithm. The dataset contains  global 0.5 x 0.5 monthly latent heating profiles from surface convective rain rate and surface stratiform rain rate.

Tags: atmosphere, clouds, earth-science
Organization: National Aeronautics and Space Administration
PROBABILITY CALIBRATION BY THE MINIMUM AND MAXIMUM PROBABILITY SCORES IN ONE-CLASS BAYES LEARNING FOR ANOMALY DETECTION

PROBABILITY CALIBRATION BY THE MINIMUM AND MAXIMUM PROBABILITY
SCORES IN ONE-CLASS BAYES LEARNING FOR ANOMALY DETECTION

GUICHONG LI, NATHALIE JAPKOWICZ, IAN HOFFMAN, R. KURT UNGAR

ABSTRACT. One-class Bayes learning such as one-class Naïve Bayes and one-class Bayesian
Network employs Bayes learning to build a classifier on the positive class only for discriminating
the positive class and the negative class. It has been applied to anomaly detection for identifying
abnormal behaviors that deviate from normal behaviors. Because one-class Bayes classifiers can
produce probability score, which can be used for defining anomaly score for anomaly detection,
they are preferable in many practical applications as compared with other one-class learning
techniques. However, previously proposed one-class Bayes classifiers might suffer from poor
probability estimation when the negative training examples are unavailable. In this paper, we
propose a new method to improve the probability estimation. The improved one-class Bayes
classifiers can exhibits high performance as compared with previously proposed one-class Bayes
classifiers according to our empirical results.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
The ProADAPT System in the 2009 Diagnostic Challenge Competition

Reliable systems health management is an important research area of NASA. A health management system that can accurately and quickly diagnose faults in various on-board systems of a vehicle will play a key role in the success of current and future NASA missions. We introduce in this paper the ProDiagnose algorithm, a diagnostic algorithm that uses a probabilistic approach, accomplished with Bayesian Network models compiled to Arithmetic Circuits, to diagnose these systems. We describe the ProDiagnose algorithm, how it works, and the probabilistic models involved. We show by experimentation on two Electrical Power Systems based on the ADAPT testbed, used in the Diagnostic Challenge Competition (DX-09), that ProDiagnose can produce results with over 96% accuracy and < 1 second mean diagnostic time.

**Reference:**

B. W. Ricks, and O. J. Mengshoel. "The Diagnostic Challenge Competition: Probabilistic Techniques for Fault Diagnosis in Electrical Power Systems." Proc. of the 20th International workshop on Principles of Diagnosis (DX-09) Stockholm, Sweden, 2009

**BibTex Reference:**

@inproceedings{ricks09diagnostic,
  author    = {Ricks, B. W. and Mengshoel, O. J.},
  title     = {The Diagnostic Challenge Competition: Probabilistic Techniques for Fault Diagnosis in Electrical Power Systems},
  booktitle     = {Proc. of the 20th International Workshop on Principles of Diagnosis (DX-09)},
  address = {Stockholm, Sweden},
  year      = {2009}
}

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Experimental Data Collection and Modeling for Nominal and Fault Conditions on Electro-Mechanical Actuators

Being relatively new to the field, electromechanical actuators in aerospace applications lack the knowledge base compared to ones accumulated for the other actuator types, especially when it comes to fault detection and characterization. Lack of health monitoring data from fielded systems and prohibitive costs of carrying out real flight tests push for the need of building system models and designing affordable but realistic experimental setups. This paper presents our approach to accomplish a comprehensive test environment equipped with fault injection and data collection capabilities. Efforts also include development of multiple models for EMA operations, both in nominal and fault conditions that can be used along with measurement data to generate effective diagnostic and prognostic estimates. A detailed description has been provided about how various failure modes are inserted in the test environment and corresponding data is collected to verify the physics based models under these failure modes that have been developed in parallel. A design of experiment study has been included to outline the details of experimental data collection. Furthermore, some ideas about how experimental results can be extended to real flight environments through actual flight tests and using real flight data have been presented. Finally, the roadmap leading from this effort towards developing successful prognostic algorithms for electromechanical actuators is discussed.*

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Replication of Electric Aircraft Powertrain Dynamics and Inner-Loop Control for V&V of System Health Management Routines

Software-in-the-loop and hardware-in-the-loop testing of failure prognostics and decision making tools for aircraft systems will facilitate more comprehensive and cost-effective testing than what is practical to conduct with flight tests. A framework is described for the offline recreation of dynamic loads on simulated or physical aircraft powertrain components based on a real-time simulation of airframe dynamics running on a flight simulator, an inner-loop flight control policy executed by either an autopilot routine or a human pilot, and a supervisory fault management control policy. The offline testing framework is described for the example of battery charge depletion failure scenarios onboard a prototype electric unmanned aerial vehicle.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
AfriSAR LVIS L1B Geolocated Return Energy Waveforms V001

This data set contains return energy waveform data over Gabon, Africa. The measurements were taken by the NASA Land, Vegetation, and Ice Sensor (LVIS), an airborne lidar scanning laser altimeter. The data were collected as part of a NASA campaign, in collaboration with the European Space Agency (ESA) mission AfriSAR.

Tags: earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
TOVS LMD DAILY GRIDS from NOAA-10 V01 (TOVSBDNG) at GES DISC

Level 3 parameters from HIRS/2 and MSU radiances using the Improved Initialization Inversion (3I) classification retrieval scheme by the Laboratoire de  Meteorologie Dynamique (Ecole Polytechnique) averaged over 1 day and mapped on to a 1x1 degree grid. This data was run as part of the NASA TOVS Pathfinder project and designated as Path-B. This dataset contains data from the NOAA-10 satellite.

Tags: atmosphere, atmospheric-chemistry, atmospheric-temperature, atmospheric-water-vapor, clouds, earth-science
Organization: National Aeronautics and Space Administration
SENTINEL-1A_DUAL_POL_GRD_FULL_RES

Sentinel-1A Dual-pol ground range detected full resolution images

Tags: agriculture, biosphere, coastal-processes, cryosphere, earth-science, erosion-sedimentation, forest-science, frozen-ground, geomorphic-landforms-processes, glaciers-ice-sheets, land-surface, land-use-land-cover, landscape, ocean-waves, ocean-winds, oceans, sea-ice, snow-ice, solid-earth, surface-water, tectonics, terrestrial-ecosystems, terrestrial-hydrosphere, topography
Organization: National Aeronautics and Space Administration
Solving a prisoner's dilemma in distributed anomaly detection

Anomaly detection has recently become an important problem in many industrial and financial applications. In several instances, the data to be analyzed for possible anomalies is located at multiple sites and cannot be merged due to practical constraints such as bandwidth limitations and proprietary concerns. At the same time, the size of data sets affects prediction quality in almost all data mining applications. In such circumstances, distributed data mining algorithms may be used to extract information from multiple data sites in order to make better predictions. In the absence of theoretical guarantees, however, the degree to which data decentralization affects the performance of these algorithms is not known, which reduces the data providing participants' incentive to cooperate.This creates a metaphorical 'prisoners' dilemma' in the context of data mining.

 

In this work, we propose a novel general framework for distributed anomaly detection with theoretical performance guarantees. Our algorithmic approach combines existing anomaly detection procedures with a novel method for computing global statistics using local sufficient statistics. We show that the performance of such a distributed approach is indistinguishable from that of a centralized instantiation of the same anomaly detection algorithm, a condition that we call zero information loss. We further report experimental results on synthetic as well as real-world data to demonstrate the viability of our approach.

 The remaining content of this presentation is presented in Fig. 1.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Early Detection of Overheating Polytetrafluoroethylene Insulated Wires Project

&lt;p&gt;The objective of the proposed work is to develop a rapid time response diagnostic using a suite of instruments for the detection of heated&amp;nbsp;polytetrafluoroethylene (PTFE) insulated wires based on chemicals and particles generated at relatively low temperatures. &amp;nbsp;The anticipated result of the proposed effort is the development of a conceptual design for an early warning system that can specifically detect the overheating of&amp;nbsp;polytetrafluoroethylene (PTFE) insulated wires. This design can be utilized as a subsystem integrated into a fully capable fire detection system.&lt;/p&gt;

Tags: completed, glenn-research-center, project
Organization: National Aeronautics and Space Administration
A KNOWLEDGE DISCOVERY STRATEGY FOR RELATING SEA SURFACE TEMPERATURES TO FREQUENCIES OF TROPICAL STORMS AND GENERATING PREDICTIONS OF HURRICANES UNDER 21ST-CENTURY GLOBAL WARMING SCENARIOS

A KNOWLEDGE DISCOVERY STRATEGY FOR RELATING SEA SURFACE
TEMPERATURES TO FREQUENCIES OF TROPICAL STORMS AND
GENERATING PREDICTIONS OF HURRICANES UNDER 21ST-CENTURY
GLOBAL WARMING SCENARIOS

CAITLIN RACE*, MICHAEL STEINBACH*, AUROOP GANGULY**, FRED SEMAZZI***,
AND VIPIN KUMAR*

Abstract. The connections among greenhouse-gas emissions scenarios, global warming, and frequencies
of hurricanes or tropical cyclones are among the least understood in climate science
but among the most fiercely debated in the context of adaptation decisions or mitigation policies.
Here we show that a knowledge discovery strategy, which leverages observations and climate
model simulations, offers the promise of developing credible projections of tropical cyclones based
on sea surface temperatures (SST) in a warming environment. While this study motivates the
development of new methodologies in statistics and data mining, the ability to solve challenging
climate science problems with innovative combinations of traditional and state-of-the-art methods
is demonstrated. Here we develop new insights, albeit in a proof-of-concept sense, on the relationship
between sea surface temperatures and hurricane frequencies, and generate the most likely
projections with uncertainty bounds for storm counts in the 21st-century warming environment
based in turn on the Intergovernmental Panel on Climate Change Special Report on Emissions
Scenarios. Our preliminary insights point to the benefits that can be achieved for climate science
and impacts analysis, as well as adaptation and mitigation policies, by a solution strategy that
remains tailored to the climate domain and complements physics-based climate model simulations
with a combination of existing and new computational and data science approaches.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
GPM Ground Validation Composite Satellite Overpasses OLYMPEX V4

The GPM Ground Validation Composite Satellite Overpasses OLYMPEX dataset provides brightness temperature, precipitation, and total column water vapor estimates from multiple satellite overpasses including DMSP F16-19, GCOM-W1, GPM, MetOp, NOAA, and NPP for the OLYMPEX field campaign. The OLYMPEX field campaign took place between November, 2015, and January, 2016, with additional ground sampling continuing through February, on the Olympic Peninsula in the Pacific Northwest of the United States. This field campaign provides ground-based validation support of the findings resulting from the Global Precipitation Measurement (GPM) Core Observatory satellite. Data files are available from November 1, 2015 thru May 1, 2016 in HDF-5 format.

Tags: atmosphere, atmospheric-water-vapor, earth-science, microwave, precipitation, spectral-engineering
Organization: National Aeronautics and Space Administration
UARS Correlative NMC Daily Gridded Stratospheric Assimilated Data V001 (UARZCNMC) at GES DISC

The UARS Correlative assimilation data from NOAA's National Meteorological Center (NMC) consists of daily model runs at 12 GMT as a means of providing an independent analysis for comparison with data from the UARS instruments. The NMC data product includes temperature (Kelvin), humidity (%), geopotential height (m), and zonal and meridional wind components (m/s).

Geopotential height and atmospheric temperature data are derived from two analysis systems: 1) tropospheric fields from 1000 to 100 mb, and 2) stratospheric analyses from 70 to 0.4 mb. The tropospheric fields are the 12 GMT gridded fields which are part of the Global Daily Assimilation System (GDAS), where data from radiosondes, aircraft, satellites, ships, bouys, or any other conventional means are assimilated and merged into meteorological fields (heights, temperature, winds). The stratospheric analyses are 12 GMT operational analyses at the 70 - 0.4 mb pressure levels produced from satellite temperature retrievals and RAOBS via a modified Cressman analysis. Tropospheric temperature analyses use combined NOAA-10 and NOAA-11 data. Moisture (northern hemisphere only) and Winds data are obtained from the NMC GDAS.

The gridded fields are on the standard 65 x 65 NMC polar stereographic grid oriented 80W (grid increment 381 km at 60N), and 100E (grid increment 381 km at 60S); Pole at (33,33). The NMC uses 18 standard pressure levels for data at 1000, 850, 700, 500, 400, 300, 250, 200, 150, 100, 70, 50, 30, 10, 5, 2, 1, 0.4 millibars. Height and temperature data are produced at all 18 pressure levels from 1000 mb to 0.4 mb. Moisture data are only produced in the northern hemisphere for the 6 lowest altitude pressure levels. Wind data are produced for the 12 lowest altitude levels in the northern hemisphere, and at the 4 levels 1000, 500, 300, and 250 mb in the southern hemisphere.

There are four data files representing each subtype per day. Included in the NMC correlative data set will be a geographical data richness file. This file is used by the NMC access routines, and indicates the radiosonde coverage for each point on the NMC grid. The data files are available in a binary record oriented format.

Tags: altitude, atmosphere, atmospheric-temperature, atmospheric-water-vapor, atmospheric-winds, earth-science
Organization: National Aeronautics and Space Administration
THIR/Nimbus-7 Level 1 Cloud Data for SBUV/TOMS V001 (THIRN7L1BCLT) at GES DISC

THIRN7L1BCLT is the Nimbus-7 Temperature-Humidity Infrared Radiometer (THIR) Level 1 Cloud Data for SBUV/TOMS (BCLT) product and contains total cloud amounts; radiances at three cloud altitudes: low (below 2km), middle (2 to 7 km depending on latitude), and height (above the middle cloud layer); cirrus and deep convective clouds; and mean and RMS deviations of cloud and surface radiances. Data are averaged orbit by orbit onto each of the Nimbus 7 TOMS IFOV, which vary from 50 km to 50 km at nadir to 200 km x 200 km at the edges, as well as SBUV 180 km x 180 km IFOVs. The BCLT product includes improved cloud estimation compared to the earlier CLT product.

Each file contains one day of data (~14 orbits per day). Spatial coverage is global. The data are available from October 31, 1978 (day of year 304) through October 27, 1984 (day of year 301).

This product was previously available from the NSSDC with the identifier ESAD-00196 (old ID 78-098A-10E)

Tags: earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
Terra MODIS Level-3 Global Binned 11µm Nighttime Sea Surface Temperature (NSST) - Near Real-time (NRT) Data, version R2019.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: earth-science, national-geospatial-data-asset, ngda, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration