AndreaBozzo/ceres-open-data-index huggingface dataset:
Sounder SIPS: Suomi NPP CrIMSS Level 3 Comprehensive Quality Control Gridded Daily CLIMCAPS Full Spectral Resolution V2 at GES DISC

WARNING: To users of the derived product “co_mmr_midtrop” (carbon monoxide mass mixing ratio to dry air [kg/kg] at ~500 hPa). This variable has a significant bias due to a conversion error: the molecular weight of carbon dioxide (CO2, 44.01 g/mol) was used instead of carbon monoxide (CO, 28.01 g/mol). To correct, simply multiply “co_mmr_midtrop” by 28.01/44.01. Alternatively, derive a profile of mass mixing ratio from scratch using the retrieved column density values (“mol_lay/co_mol_lay”) in the Level 2 files. For further questions or concerns please contact the Sounder SIPS at: sounder.sips@jpl.nasa.gov

The CLIMCAPS (Community Long-term Infrared Microwave Coupled Product System) algorithm is used to analyze data from the Cross-track Infrared Sounder/Advanced Technology Microwave Sounder (CrIS/ATMS) instruments, also known as CrIMSS (Cross-track Infrared and Microwave Sounding Suite). The CrIS/ATMS instruments used for this product are on board the Suomi National Polar-orbiting Partnership (SNPP) platform and use the Full Spectral Resolution (FSR) data. The CrIS instrument is a Fourier transform spectrometer with a total of 2211 FSR infrared sounding channels covering the longwave (645-1095 cm-1), midwave (1210-1750 cm-1), and shortwave (2000-2550 cm-1) spectral regions. The ATMS instrument  is a cross-track scanner with 22 channels in spectral bands from 23 GHz through 183 GHz.
 
The CLIMCAPS algorithm uses an Optimal Estimation methodology and uses an a-priori first guess to start the process. A CLIMCAPS sounding is comprised of a set of parameters that characterizes the full atmospheric state and includes a variety of geophysical parameters derived from the CrIMSS data. These include surface temperature and infrared emissivity; full atmosphere profiles of temperature, water vapor and ozone; infrared effective cloud top characteristics; carbon monoxide, methane, carbon dioxide, sulfur dioxide, nitrous oxide, and nitric acid.
 
This daily one degree latitude by one degree longitude level-3 product starts with level-2 retrieval products with QC values of 0 (best), 1 (good), and 2 (don't use) which are provided for each variable. Comprehensive QC accepts a retrieval if the profile is good to the surface and ensures consistent analysis across all levels and variables.

Tags: air-quality, altitude, atmosphere, atmospheric-chemistry, atmospheric-pressure, atmospheric-radiation, atmospheric-temperature, atmospheric-water-vapor, clouds, earth-science, land-surface, ocean-temperature, oceans, precipitation, surface-radiative-properties, surface-thermal-properties
Organization: National Aeronautics and Space Administration
GPM GROUND VALIDATION NASA ER-2 NAVIGATION DATA MC3E V1

The GPM Ground Validation NASA ER-2 Navigation Data MC3E dataset contains information recorded by an on board navigation recorder (NavRec). In addition to typical navigation data (e.g. date, time, lat/lon and altitude) it contains outside meteorological parameters such as wind speed, wind direction, and temperature. These ASCII text files were recorded every second for the length of the flight. The Flight Summaries and Flight Track Imagery dataset which includes sonde maps, radar animation, and 5-minute KICT track snapshots is distributed with this dataset.

Tags: atmosphere, atmospheric-temperature, atmospheric-winds, earth-science, platform-characteristics, spectral-engineering
Organization: National Aeronautics and Space Administration
SMAP_L1A_RADAR_RECEIVE_ONLY_QA_V003

SMAP Level 1A Radar Receive Only Data Quality Information Version 3

Tags: active-remote-sensing, earth-observation-satellites, earth-remote-sensing-instruments, earth-science, imaging-radars, nasa-decadal-survey, platform-characteristics, radar, smap, spectral-engineering
Organization: National Aeronautics and Space Administration
LAT FTP Data

Fermi is a powerful space observatory that will open a wide window on the universe. Gamma rays are the highest-energy form of light, and the gamma-ray sky is spectacularly different from the one we perceive with our own eyes. With a huge leap in all key capabilities, Fermi data will enable scientists to answer persistent questions across a broad range of topics, including supermassive black-hole systems, pulsars, the origin of cosmic rays, and searches for signals of new physics.

Tags: astrophysics, gamma-ray-bursts, gbm, lat, light-arcs, particle-physics, photons, pulsars, solar-flares, space-science
Organization: National Aeronautics and Space Administration
VIIRS/NPP Sea Ice Cover 6-Min L2 Swath 375 m V001

This data set reports the location of sea ice cover derived from radiance data acquired by the Visible Infrared Imager Radiometer Suite (VIIRS). Following the approach used by MODIS, Sea Ice is detected using the Normalized Difference Snow Index. The VIIRS instrument flies onboard the Suomi National Polar-orbiting Partnership (NPP) satellite.

Tags: cryosphere, earth-science, sea-ice
Organization: National Aeronautics and Space Administration
Description, Classification and Inventory of 151 Apollo 16 Rake Samples from the LM area and Station 5

Description, Classification and Inventory of 151 Apollo 16 Rake Samples from the LM area and Station 5; K. Keil, E. Dowty, M. Prinze and T.E. Bunch

Tags: apollo, catalog, lunar, sample
Organization: National Aeronautics and Space Administration
TROPICS01 L2B Neural-network Atmospheric Vertical Temperature & Moisture Profiles V1.0

The "Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats" (TROPICS) mission has a goal of providing nearly all-weather observations of three-dimensional temperature and humidity, as well as cloud ice and precipitation horizontal structure, at high temporal resolution to conduct high-value science investigations of tropical cyclones. The mission comprises a constellation of five identical Space Vehicles (SVs) conforming to the 3U form factor and hosting a passive microwave spectrometer payload.

Each SV hosts an identical high-performance spectrometer named the TROPICS Millimeter-wave Sounder (TMS) that will provide temperature profiles using seven channels near the 118.75-GHz oxygen absorption line, water vapor profiles using three channels near the 183-GHz water vapor absorption line, imagery in a single channel near 90 GHz for precipitation measurements (when combined with higher resolution water vapor channels), and a single channel near 205 GHz that is more sensitive to cloud-sized ice particles.

This dataset is the Level-2B Neural Network Atmospheric Vertical Profiles (NNAVP) – Neural Network vertical profile retrieval approach for temperature profiles in Kelvin (K) and water vapor mixing ratio profiles in (kg/kg).  Retrievals are done in all non and precipitating conditions, over both land and ocean. Temperature profiles go from surface to 20 km and water profiles from surface to 10-km. The geophysical retrieval of atmospheric vertical temperature is at the larger unified F-band spatial resolution while the retrieval of vertical moisture is at the finer G-band spatial resolution. Each TROPICS netCDF file contains a granule of data with 81 spots and approximately 2880 scans, where a granule is defined as an orbit's worth of data.

Tags: earth-science, microwave, spectral-engineering
Organization: National Aeronautics and Space Administration
A Scalable Local Algorithm for Distributed Multivariate Regression

This paper offers a local distributed algorithm for multivariate regression in large peer-to-peer environments. The algorithm can be used for distributed inferencing, data compaction, data modeling and classification tasks in many emerging peer-to-peer applications for bioinformatics, astronomy, social networking, sensor networks and web mining. Computing a global regression model from data available at the different peer-nodes using a traditional centralized algorithm for regression can be very costly and impractical because of the large number of data sources, the asynchronous nature of the peer-to-peer networks, and dynamic nature of the data/network. This paper proposes a two-step approach to deal with this problem. First, it offers an efficient local distributed algorithm that monitors the quality  of the current regression model. If the model is outdated, it uses this algorithm as a feedback mechanism for rebuilding the model. The local nature of the monitoring algorithm guarantees low monitoring cost. Experimental results presented in this paper strongly support the theoretical claims.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Accelerated Aging Platform for Prognostics of Power Electronics

To advance the field of electronics prognostics, the study of transistor fault modes and their precursors is essential. This paper reports on a platform for the aging, characterization, and scenario simulation of gate controlled power transistors. The platform supports thermal cycling, dielectric over-voltage, acute/chronic thermal stress, current overstress and application specific scenario simulation. In addition, the platform supports in- situ transistor state monitoring, including measurements of the steady-state voltages and currents, measurements of electrical transient response, measurement of thermal transients, and extrapolated semiconductor impedances, all conducted at varying gate and drain voltage levels. The aging and characterization platform consists of an acquisition and aging hardware system, an agile software architecture for experiment control and a collection of industry developed test equipment.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Advancement and New Optimizations of Microcalorimeter Arrays for High-Resolution Imaging X-ray Spectroscopy Project

"We propose to continue our successful research program in developing x-ray microcalorimeter arrays for astrophysics.  This development will directly benefit not only the International X-ray Observatory (IXO), but also other possible mission concepts.  We will investigate various array and pixel optimizations such as would be needed for large arrays for surveys, or arrays of fast pixels optimized for neutron star burst spectroscopy.



The main emphasis of our research will be the further development of arrays of superconducting transition-edge sensors (TES) for imaging x-ray spectroscopy.   We have developed a TES pixel that achieves better than 2.5-eV resolution at 6 keV, and arrays of such pixels that are sufficiently uniform in characteristics  as to permit common biasing without significant compromises in the operation of any pixel.   We are also making arrays of position sensitive TES pixels that show promise for use on IXO.  We propose to advance both the single-pixel and position-sensitive arrays so that we can produce arrays suitable for subsystem-level read-out demonstrations of the IXO X-ray Microcalorimeter Spectrometer focal plane.



Additionally, we propose to re-evaluate out successful pixel design which, while certainly suitable for use in developing the architecture of arrays and addressing detector systems issues, is not necessarily the final optimization. The performance of a TES depends on the functional form of the current, temperature, and magnetic-field dependence of the resistive transition, and also on the noise at each point on this transition surface.  The parameters that describe this transition surface occupy a large phase space, and we have only probed a small portion of it. We propose to fabricate a series of test devices to explore other parts of the phase space and to learn how to engineer the superconducting transition. Recently, our understanding of the physical effects governing the observed resistive transitions has improved, th

Tags: active, goddard-space-flight-center, project
Organization: National Aeronautics and Space Administration
GRC 8x6 SWT Raised Floor Calibration Data

This is a database of relevant data from the Boundary Layer Ingesting Inlet / Distortion Tolerant Fan (BLI2DTF) Raised Floor Calibration Test in the 8-foot by 6-foot Supersonic Wind Tunnel at NASA Glenn Research Center completed in May 2016. This database accompanies the report from that test:

Stefanie M. Hirt, David J. Arend, John D. Wolter, and Aaron M. Johnson. "Development of a Flow Field for Testing a Boundary-Layer-Ingesting Propulsor", NASA/TM-2017-219554 (https://ntrs.nasa.gov/citations/20205009731) & AIAA 2017-5043 (https://doi.org/10.2514/6.2017-5043)

Tags: boundary-layer-ingestion, wind-tunnel-calibration
Organization: National Aeronautics and Space Administration
Aqua MODIS Level-3 Global Mapped 4µm Nighttime Sea Surface Temperature (SST4) Data, version R2019.0

MODIS (or Moderate-Resolution Imaging Spectroradiometer) is a key instrument aboard the Terra (EOS AM) and Aqua (EOS PM) satellites. Terra's orbit around the Earth is timed so that it passes from north to south across the equator in the morning, while Aqua passes south to north over the equator in the afternoon. Terra MODIS and Aqua MODIS are viewing the entire Earth's surface every 1 to 2 days, acquiring data in 36 spectral bands, or groups of wavelengths (see MODIS Technical Specifications). These data will improve our understanding of global dynamics and processes occurring on the land, in the oceans, and in the lower atmosphere. MODIS is playing a vital role in the development of validated, global, interactive Earth system models able to predict global change accurately enough to assist policy makers in making sound decisions concerning the protection of our environment.

Tags: earth-science, national-geospatial-data-asset, ngda, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
Anomaly Detection in Sequences

We present a set of novel algorithms which we call sequenceMiner, that detect and characterize anomalies in large sets of high-dimensional symbol sequences that arise from recordings of switch sensors in the cockpits of commercial airliners. While the algorithms we present are general and domain-independent, we focus on a specific
problem that is critical to determining system-wide health
of a fleet of aircraft. The approach taken uses unsupervised clustering of sequences using the normalized length of he longest common subsequence (nLCS) as a similarity measure, followed by a detailed analysis of outliers to detect anomalies. In this method, an outlier sequence is defined as a sequence that is far away from a cluster. We present new algorithms for outlier analysis that provide comprehensible indicators as to why a particular sequence is deemed to be an outlier. The algorithm provides a coherent description to an analyst of the anomalies in the sequence when compared to more normal sequences.

The final section of the paper demonstrates the effectiveness of sequenceMiner for anomaly detection on a real set of discrete sequence data from a fleet of commercial airliners.


We show that sequenceMiner discovers actionable and
operationally significant safety events. We also compare
our innovations with standard HiddenMarkov Models, and
show that our methods are superior

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
New Approaches To Photometric Redshift Prediction

Expanding upon the work of Way & Srivastava (2006) we demonstrate how the use of training sets of comparable size continue to make Gaussian Process Regression a competitive approach to that of Neural Networks and other least squares fitting methods. This is possible via new large size matrix inversion techniques developed for Gaussian Processes that do not require that the kernel matrix be sparse. This development, combined with a neural-network kernel function appears to give superior results for this problem. Our best t results for the Sloan Digital Sky Survey Main Galaxy Sample using u,g,r,i,z gives an rms error of 0.0201 while our results for the same in the Luminous Red Galaxy Sample yield 0.0220.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
USGS High Resolution Orthoimagery

High resolution orthorectified images combine the image characteristics of an aerial photograph with the geometric qualities of a map. An orthoimage is a uniform-scale image where corrections have been made for feature displacement such as building tilt and for scale variations caused by terrain relief, sensor geometry, and camera tilt. A mathematical equation based on ground control points, sensor calibration information, and a digital elevation model is applied to each pixel to rectify the image to obtain the geometric qualities of a map.

A digital orthoimage may be created from several photographs mosaicked to form the final image. The source imagery may be black-and-white, natural color, or color infrared with a pixel resolution of 1-meter or finer. With orthoimagery, the resolution refers to the distance on the ground represented by each pixel.

Tags: agriculture, earth-science, forest-science, land-surface, surface-radiative-properties, topography
Organization: National Aeronautics and Space Administration
GPM GROUND VALIDATION OKLAHOMA CLIMATOLOGICAL SURVEY MESONET MC3E V1

The GPM Ground Validation Oklahoma Climatological Survey Mesonet MC3E data were collected during the Midlatitude Continental Convective Clouds Experiment (MC3E) in central Oklahoma during the April-June 2011 period. The overarching goal was to provide the most complete characterization of convective cloud systems, precipitation, and the environment that has ever been obtained, providing constraints for model cumulus parameterizations and space-based rainfall retrieval algorithms over land that had never before been available. Collected by a network of weather stations, this dataset is composed of 15 minute and 5 minute files with one file per site per day in mts format. Data can be read as ASCII text. Multiple parameters found in this dataset include relative humidity, air temperature, wind speed and direction, precipitation and calibrated soil moisture. More information on the contents and data format can be found at http://www.mesonet.org/index.php/site/about/mdf_mts_files.

Tags: agriculture, atmosphere, atmospheric-pressure, atmospheric-temperature, atmospheric-water-vapor, atmospheric-winds, climate-indicators, earth-science, land-surface-agriculture-indicators, precipitation, soils
Organization: National Aeronautics and Space Administration
NOAA-20 VIIRS Level-3 Global Mapped 11µm Daytime Sea Surface Temperature (SST) Data, version R2024.0

The Visible and Infrared Imager/Radiometer Suite (VIIRS) is a multi-disciplinary instrument that is being flown on the Joint Polar Satellite System (JPSS) series of spacecraft, including the Suomi National Polar-orbiting Partnership (S-NPP) that launched in October 2011.  JPSS is a multi-platform, multi-agency program that consolidates the polar orbiting spacecraft of NASA and the National Oceanic and Atmospheric Administration (NOAA).  S-NPP is the initial spacecraft in this series, and VIIRS is the successor to MODIS for Earth science data product generation.  VIIRS has 22 spectral bands ranging from 412 nm to 12 nm.  There are 16 moderate-resolution bands (750m at nadir), 5 image-resolution bands (375m), and one day-night band (DNB).

Tags: earth-science, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
Aqua MODIS Level-2 Regional 4µm Nighttime Sea Surface Temperature (SST4) Data, version R2019.0

MODIS (or Moderate-Resolution Imaging Spectroradiometer) is a key instrument aboard the Terra (EOS AM) and Aqua (EOS PM) satellites. Terra's orbit around the Earth is timed so that it passes from north to south across the equator in the morning, while Aqua passes south to north over the equator in the afternoon. Terra MODIS and Aqua MODIS are viewing the entire Earth's surface every 1 to 2 days, acquiring data in 36 spectral bands, or groups of wavelengths (see MODIS Technical Specifications). These data will improve our understanding of global dynamics and processes occurring on the land, in the oceans, and in the lower atmosphere. MODIS is playing a vital role in the development of validated, global, interactive Earth system models able to predict global change accurately enough to assist policy makers in making sound decisions concerning the protection of our environment.

Tags: earth-science, national-geospatial-data-asset, ngda, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
DISTRIBUTED ANOMALY DETECTION USING SATELLITE DATA FROM MULTIPLE MODALITIES

DISTRIBUTED ANOMALY DETECTION USING SATELLITE DATA FROM
MULTIPLE MODALITIES

KANISHKA BHADURI*, KAMALIKA DAS**, AND PETR VOTAVA***

Abstract. There has been a tremendous increase in the volume of Earth Science data over the
last decade from modern satellites, in-situ sensors and different climate models. All these datasets
need to be co-analyzed for finding interesting patterns or for searching for extremes or outliers.
Information extraction from such rich data sources using advanced data mining methodologies is
a challenging task not only due to the massive volume of data, but also because these datasets
ate physically stored at different geographical locations. Moving these petabytes of data over the
network to a single location may waste a lot of bandwidth, and can take days to finish. To solve this
problem, in this paper, we present a novel algorithm which can identify outliers in the global data
without moving all the data to one location. The algorithm is highly accurate (close to 99%) and
requires centralizing less than 5% of the entire dataset. We demonstrate the performance of the
algorithm using data obtained from the NASA MODerate-resolution Imaging Spectroradiometer
(MODIS) satellite images.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
PADMINI: A PEER-TO-PEER DISTRIBUTED ASTRONOMY DATA MINING SYSTEM AND A CASE STUDY

PADMINI: A PEER-TO-PEER DISTRIBUTED ASTRONOMY DATA MINING
SYSTEM AND A CASE STUDY

TUSHAR MAHULE*, KIRK BORNE**, SANDIPAN DEY*, SUGANDHA ARORA*,
AND HILLOL KARGUPTA***

Abstract. Peer-to-Peer (P2P) networks are appealing for astronomy data mining from virtual
observatories because of the large volume of the data, compute-intensive tasks, potentially large
number of users, and distributed nature of the data analysis process. This paper offers a brief
overview of PADMINI—a Peer-to-Peer Astronomy Data MINIng system. It also presents a case
study on PADMINI for distributed outlier detection using astronomy data. PADMINI is a webbased
system powered by Google Sky and distributed data mining algorithms that run on a
collection of computing nodes. This paper offers a case study of the PADMINI evaluating the
architecture and the performance of the overall system. Detailed experimental results are presented
in order to document the utility and scalability of the system.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration