AndreaBozzo/ceres-open-data-index huggingface dataset:
Shuttle SBUV (SSBUV) Level 2 Ozone Profile and Total Column, Aerosol Index, and UV-Reflectivity V008 (SSBUVO3) at GES DISC

The Shuttle Solar Backscatter Ultraviolet (SSBUV) Level-2 Ozone data are available for eight space shuttle missions flown between 1989 and 1996. SSBUV, a successor to the SBUV flown on the Nimbus-7 satellite, is nearly identical to the SBUV/2 instruments flying on the NOAA satellites. Data are available in the ASCII AMES text format. Ozone profiles of the upper atmosphere and total column ozone values are available for the following time periods:

Flight #1:  1989 October 19, 20, 21.
Flight #2:  1990 October 7, 8, 9.
Flight #3:  1991 August 3, 4, 5, 6.
Flight #4:  1992 March 29, 31.
Flight #5:  1993 April 9, 11, 13, 15, 16.
Flight #6:  1994 March 14, 15, 17.
Flight #7:  1994 November 5, 7, 10, 13.
Flight #8:  1996 January 12, 16, 18.

SSBUV measures spectral ultraviolet radiances backscattered by the earth's atmosphere. For the ozone measurements the instrument steps over wavelengths between 252.2 and 339.99 nm while viewing the earth in the nadir position (50 km x 50 km footprint at nadir) at 19 pressure levels between 0.3 mb and 100 mb.

Tags: aerosols, atmosphere, atmospheric-chemistry, atmospheric-radiation, earth-science
Organization: National Aeronautics and Space Administration
SWOT Level 2 KaRIn Low Rate Sea Surface Height Data Product - Expert, Version 2.0

The SWOT Level 2 KaRIn Low Rate Sea Surface Height Expert Data Product from the Surface Water Ocean Topography (SWOT) mission provides global sea surface height and significant wave height observations derived from low rate (LR) measurements from the Ka-band Radar Interferometer (KaRIn). SWOT launched on December 16, 2022 from Vandenberg Air Force Base in California into a 1-day repeat orbit for the "calibration" or "fast-sampling" phase of the mission, which completed in early July 2023. After the calibration phase, SWOT entered a 21-day repeat orbit in August 2023 to start the "science" phase of the mission, which is expected to continue through 2025. <br>
The L2 sea surface height data product is distributed in one netCDF-4 file per pass (half-orbit) covering the full KaRIn swath width, which spans 10-60km on each side of the nadir track. Sea surface height, sea surface height anomaly, wind speed, significant waveheight, and related parameters are provided on a geographically fixed, swath-aligned 2x2 km2 grid (Basic, Expert, Windwave). The sea surface height data are also provided on a finer 250x250 m2 "native" grid with minimal smoothing applied (Unsmoothed). <br>
This collection is a sub-collection of its parent: https://podaac.jpl.nasa.gov/dataset/SWOT_L2_LR_SSH_2.0  It provides the "Expert" file from each L2 SSH product, which contain all related variables and is intended for expert users.

Tags: earth-science, ocean-waves, oceans, sea-surface-topography
Organization: National Aeronautics and Space Administration
DATA MINING THE GALAXY ZOO MERGERS

DATA MINING THE GALAXY ZOO MERGERS

STEVEN BAEHR*, ARUN VEDACHALAM*, KIRK BORNE*, AND DANIEL SPONSELLER*

Abstract. Collisions between pairs of galaxies usually end in the coalescence (merger) of the two
galaxies. Collisions and mergers are rare phenomena, yet they may signal the ultimate fate of
most galaxies, including our own Milky Way. With the onset of massive collection of astronomical
data, a computerized and automated method will be necessary for identifying those colliding
galaxies worthy of more detailed study. This project researches methods to accomplish that goal.
Astronomical data from the Sloan Digital Sky Survey (SDSS) and human-provided classifications
on merger status from the Galaxy Zoo project are combined and processed with machine learning
algorithms. The goal is to determine indicators of merger status based solely on discovering those
automated pipeline-generated attributes in the astronomical database that correlate most strongly
with the patterns identified through visual inspection by the Galaxy Zoo volunteers. In the end,
we aim to provide a new and improved automated procedure for classification of collisions and
mergers in future petascale astronomical sky surveys. Both information gain analysis (via the
C4.5 decision tree algorithm) and cluster analysis (via the Davies-Bouldin Index) are explored as
techniques for finding the strongest correlations between human-identified patterns and existing
database attributes. Galaxy attributes measured in the SDSS green waveband images are found to
represent the most influential of the attributes for correct classification of collisions and mergers.
Only a nominal information gain is noted in this research, however, there is a clear indication of
which attributes contribute so that a direction for further study is apparent.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
High Mountain Asia 1 km MODIS-AIRS Gap-Filled Ground Temperatures and Permafrost Probability Maps, 2003-2016 V001

This data set consists of 1 km resolution monthly land surface temperatures (MLSTs); mean annual ground temperatures (MAGTs); and estimates of permafrost extent (PE) in the High Mountain Asia region from 1 Jan 2003 – 31 Dec 2016.

The data were generated by gap-filling daily MODIS Terra/Aqua Land surface temperatures (LSTs) with downscaled Atmospheric Infra-Red Sounder (AIRS) skin surface temperatures.

Tags: cryosphere, earth-science, frozen-ground, land-surface, national-geospatial-data-asset, ngda, surface-thermal-properties
Organization: National Aeronautics and Space Administration
Integrating Systems Health Management with Adaptive Controls for a Utility-scale Wind Turbine

Increasing turbine up-time and reducing maintenance costs are key technology drivers for wind turbine operators. Components within wind turbines are subject to considerable stresses due to unpredictable environmental conditions resulting from rapidly changing local dynamics. Systems health management has the aim to assess the state-of-health of components within a wind turbine, to estimate remaining life, and to aid in autonomous decision-making to minimize damage. Advanced adaptive controls can provide the mechanism to enable optimized operations that also provide the enabling technology for Systems Health Management goals. The work reported herein explores the integration of condition monitoring of wind turbine blades with contingency management and adaptive controls. Results are demonstrated using a high fidelity simulator of a utility-scale wind turbine.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
SMAP_L1C_SIGMA_NAUGHT_HIGH_RES_V003

SMAP Level 1C Sigma Naught High Res Product Version 3

Tags: active-remote-sensing, earth-observation-satellites, earth-remote-sensing-instruments, earth-science, imaging-radars, nasa-decadal-survey, platform-characteristics, radar, smap, spectral-engineering
Organization: National Aeronautics and Space Administration
Aqua MODIS Level-3 Global Mapped 11µm Nighttime Sea Surface Temperature (NSST) - Near Real-time (NRT) Data, version R2019.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: earth-science, national-geospatial-data-asset, ngda, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
Anomaly Detection and Diagnosis Algorithms for Discrete Symbols

We present a set of novel algorithms which we call sequenceMiner that detect and characterize anomalies in large sets of high-dimensional symbol sequences that arise from recordings of switch sensors in the cockpits of commercial airliners. While the algorithms we present are general and domain-independent, we focus on a specific problem that is critical to determining the system-wide health of a fleet of aircraft. The approach taken uses
unsupervised clustering of sequences using the normalized length of the longest common subsequence (nLCS) as a similarity measure, followed by detailed outlier analysis to detect anomalies. In this method, an outlier sequence is defined as a sequence that is far away from the cluster centre. We present new algorithms for outlier analysis that provide comprehensible indicators as to why a particular sequence is deemed to be an outlier. The algorithms provide a coherent description to an analyst of the anomalies in the sequence when compared to more normal sequences. In the final section of the paper we demonstrate the effectiveness of sequenceMiner for anomaly detection on a real set of discrete sequence data from a fleet of commercial airliners. We show that sequenceMiner discovers actionable and operationally significant safety events. We also compare our innovations with standard HiddenMarkov Models, and show that our methods are superior.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Exploring the Frontier of Coronal Energetics with EUNIS Project

&lt;p&gt;
	&lt;strong&gt;Methodology used to answer science question:&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;
	The investigators propose to upgrade the successfully flown EUNIS EUV spectrograph, increasing its signal-to-noise ratio and replacing its 30-37 nm channel with a 52.4-63.0 nm channel to cover transition region lines.&amp;nbsp; They plan to fly the upgraded suborbital experiment, and analyze the results from this and the two previous EUNIS flights.&lt;/p&gt;

Tags: active, project, wallops-flight-facility
Organization: National Aeronautics and Space Administration
Gazetteer of Planetary Nomenclature: Asteroids: Gaspra Regions

These images display asteriods documented and approved by the International Astronomical Union (IAU).

Tags: asteriods, dactyl, eros, gaspra, ida, imagery, images, itokawa, lutetia, mathilde, steins, usgs, vesta, working-group-for-planetary-system-nomenclature
Organization: National Aeronautics and Space Administration
GPM GROUND VALIDATION PLUVIO PRECIPITATION GAUGE LPVEX V1

The GPM Ground Validation Pluvio Precipitation Gauge LPVEx dataset contains both one minute measurements and a cumulative record of the accumulation and intensity of liquid, solid, and mixed precipitation. This dataset was collected during the Light Precipitation Experiment (LPVEx) which was part of the Global Precipitation Measurement (GPM) Misson Ground Validation Experiment which took place in Finland from September 2010 to October 2010. The experiment leveraged in situ microphysical property measurements, coordinated remote sensing observations, and cloud resolving model simulations of high latitude precipitation systems to conduct a comprehensive evaluation of precipitation algorithms for current and future satellite platforms. The campaign will use these measurements to better understand the process of light rainfall formation at high latitudes and augment the currently limited database of light rainfall microphysical properties that form the critical assumptions at the root of satellite retrieval algorithm. Data were collected at three sites: Harmaja, Emasalo, and Jarvenpaa.

Tags: atmosphere, atmospheric-temperature, earth-science, precipitation
Organization: National Aeronautics and Space Administration
Trajectory Clustering with Applications to Airspace Monitoring

This paper presents a framework aimed at monitoring the behavior of aircraft in a given airspace. Trajectories that constitute typical operations are determined and learned using data-driven methods. Standard procedures are used by air traffic controllers (ATCs) to guide aircraft, ensure the safety of the airspace, and maximize runway occupancy. Even though standard procedures are used by ATCs, control of the aircraft remains with the pilots, leading to large variability in the flight patterns observed. Two methods for identifying typical operations and their variability from recorded radar tracks are presented. This knowledge base is then used to monitor the conformance of current operations against operations previously identified as typical. A tool called AirTrajectoryMiner is presented, aiming at monitoring the instantaneous health of the airspace, in real time. The airspace is “healthy” when all aircraft are flying according to typical operations. A measure of complexity is introduced, measuring the conformance of current flight to typical flight patterns. When an aircraft does not conform, the complexity increases as more attention from ATC is required to ensure safe separation between aircraft.


IEEE Transactions on Intelligent Transportation Systems, Dec. 2011, 12(4), pp. 1511 - 1524.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
SatCORPS CERES GEO Edition 4 GOES-13 Northern Hemisphere Version 1.0

CER_GEO_Ed4_GOE13_NH_V01 is the Satellite Cloud and Radiation Property retrieval System (SatCORPS) Clouds and the Earth's Radiant Energy System (CERES) Geostationary Satellite (GEO) Edition 4 Geostationary Operational Environmental Satellite 13 (GOES-13) over the Northern Hemisphere (NH) Version 1.0 data product. Data was collected using the GOES-13 Imager on the GOES-13 platform. Data collection for this product is complete. 

This data set comprises cloud micro-physical and radiation properties derived hourly from GOES-13 geostationary satellite imager data using the Langley Research Center (LaRC) SATCORPS algorithms supporting the CERES project. The cloud micro-physical and radiation properties from each active geostationary satellite are merged to create hourly global cloud properties that estimate fluxes between CERES instrument measurements to account for the changing diurnal cycle. The data set is arranged as files for each hour and in netCDF-4 format. The observations are at 4 km resolution (at nadir) and are sub-sampled to 8 km.

CERES is a key Earth Observing System (EOS) program component. The CERES instruments provide radiometric measurements of the Earth's atmosphere from three broadband channels. The CERES missions follow the successful Earth Radiation Budget Experiment (ERBE) mission. The first CERES instrument, the protoflight model (PFM), was launched on November 27, 1997, as part of the Tropical Rainfall Measuring Mission (TRMM). Two CERES instruments (FM1 and FM2) were launched into polar orbit on board the Earth Observing System (EOS) flagship Terra on December 18, 1999. Two additional CERES instruments (FM3 and FM4) were launched on board Earth Observing System (EOS) Aqua on May 4, 2002. The CERES FM5 instrument was launched on board the Suomi National Polar-orbiting Partnership (NPP) satellite on October 28, 2011. The newest CERES instrument (FM6) was launched on board the Joint Polar-Orbiting Satellite System 1 (JPSS-1) satellite, now called NOAA-20, on November 18, 2017.

Tags: atmosphere, clouds, earth-science
Organization: National Aeronautics and Space Administration
Scalable, Asynchronous, Distributed Eigen-Monitoring of Astronomy Data Streams

In this paper, we develop a distributed algorithm for monitoring the principal components (PCs) for next generation
of astronomy petascale data pipelines such as the Large Synoptic Survey Telescopes (LSST). This telescope will take repeated
images of the night sky every 20 s, thereby generating 30 terabytes of calibrated imagery every night that will need to be
co-analyzed with other astronomical data stored at different locations around the world. Event detection, classification, and
isolation in such data sets may provide useful insights to unique astronomical phenomenon displaying astrophysically significant
variations: quasars, supernovae, variable stars, and potentially hazardous asteroids. However, performing such data mining tasks
is a challenging problem for such high-throughput distributed data streams. In this paper, we propose a highly scalable and
distributed asynchronous algorithm for monitoring the PCs of such dynamic data streams and discuss a prototype web-based
system PADMINI (Peer-to-Peer Astronomy Data Mining) which implements this algorithm for use by the astronomers. We
demonstrate the algorithm on a large set of distributed astronomical data to accomplish well-known astronomy tasks such as
measuring variations in the fundamental plane of galaxy parameters. The proposed algorithm is provably correct (i.e., converges
to the correct PCs without centralizing any data) and can seamlessly handle changes to the data or the network. Real experiments
performed on Sloan Digital Sky Survey (SDSS) catalogue data show the effectiveness of the algorithm.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Mixture Density Mercer Kernels

We present a method of generating Mercer Kernels
from an ensemble of probabilistic mixture models,
where each mixture model is generated from a Bayesian
mixture density estimate. We show how to convert the
ensemble estimates into a Mercer Kernel, describe the
properties of this new kernel function, and give examples
of the performance of this kernel on unsupervised
clustering of synthetic data and also in the domain of
unsupervised multispectral image understanding.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Tackling V&V for Prognostics

We believe our approach to gathering and organizing prognostics V&V information from relevant literature, and then applying it to our specific prognostics application, provides a novel methodological way to approach V&V. Conventional literature surveys have a different purpose – they attempt to distill general themes, offer comparisons and contrasts, etc. Our intention was to provide an aid that allows the application of knowledge gleaned from the literature. It also allows the user to break down the V&V process into smaller segments and to identify potential bottlenecks which then allow focusing the attention. The specific approach we took to organizing the information – into categories of “Barriers” and “Solutions”, where each is accompanied by explanatory text from the original sources, coupled with references to the sources themselves – seems to have worked reasonably well overall. There are aspects that could be improved; the descriptive text recorded proved on occasion to be insufficient to serve as a standalone explanation of the item in question – fairly often we found the need to trace back to the original source and read more of the explanatory context; the reference to the source helped, but still meant a somewhat cumbersome process; we also feel it would have been better to have taken the time to record a reference back from an item (Barrier or Solution) to all the sources where that item, or its equivalent, were discussed; the overall hierarchical organization of these items (see Appendix for the listing of their titles) could probably be improved upon. What we found to be most useful was to use the Barriers as a series of talking points, taking notes as we went along as to our prognostics experts' understanding of whether, and if so how, that Barrier applied to our application. This process both serves as a means to capture the rationale that justifies faith in the prognostics application's approach, and to stimulate (and again capture) thoughts on areas of concern and possible approaches to addressing them.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Embedding Temporal Constraints for Coordinated Execution in Habitat Automation

Future NASA plans call for long-duration deep space
missions with human crews. Because of light-time delay and
other considerations, increased autonomy will be needed.
This will necessitate integration of tools in such areas as
anomaly detection, diagnosis, planning, and execution. In
this paper we investigate an approach that integrates planning
and execution by embedding planner-derived temporal
constraints in an execution procedure. To avoid the need for
propagation, we convert the temporal constraints to
dispatchable form. We handle some uncertainty in the
durations without it affecting the execution; larger variations
may cause activities to be skipped.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
HIRENASD Unstructured Grids - VGRID software

These grids were constructed using VGRID software from NASA Langley.  The grids designed for node based (labeled 'nc') and cell-centered solvers are supplied.  Grids with mixed elements (labeled 'mixed') and tetrahedral elements (labeled 'tets') are supplied.

Each mixed elements tar-file contains grid in aflr3 .ugrid format and the corresponding .cgns file.  Each tetrahedral elements tar-file contains grid in native VGRID format (.cogsg, .bs, .mapbc) and the corresponding .cgns file.

Some files were too large and had to be split into parts.  To combine the parts, use cat filename_part1 filename_part2 > filename.

Grids are in units of 'mm'.  Information about grids, that is number of nodes, elements, etc., is provided in AePW_HIRENASD_Grid_Statistics_VGRID.docx  

Please report any issues with these grids to Pawel.Chwalowski@nasa.gov

Please note that the final grids for Aeroelastic Prediction Workshop are due on November 1.  Therefore these grids still may change based on your initial calculations.

Soon, the mode shapes from NASTRAN interpolated on the surface mesh will be provided for above grids.

Happy Computing!

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
Smart Sensing Using Wavelets Project

&lt;p&gt;Further refinements to the FOSS technologies are focusing on &amp;ldquo;smart&amp;rdquo; sensing techniques that adjust sensing parameters as needed in real time so that only the necessary amount of data is acquired &amp;ndash; no more, no less. Traditional FOSS signal processing is based on Fourier transforms that break up the length of the fiber into analysis sections that are equal in length along the whole fiber. If high resolution is required along one portion of the fiber, the whole fiber must be processed at that resolution. Wavelet transforms make it possible to efficiently break up the length of the fiber into analysis sections that vary in length. If high resolution is required along one portion of the fiber, only that portion is processed at high resolution, and the rest of the fiber can be processed at the lower resolution.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Work to date&lt;/strong&gt;: The team has developed a C language prototype of a wavelet-based signal processing algorithm. This static form currently operates at half the speed of the Fourier-based algorithm but it will be able to operate 3-4 times faster when optimized.&amp;nbsp;The team has also developed a LabVIEW prototype of the adaptive form of the algorithm. This form provides real-time adaptive spatial resolution.&amp;nbsp;For example: when strain on a wing increases during flight, the software will automatically increase the resolution on the part of the fiber that is under strain.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Looking ahead&lt;/strong&gt;: Next steps involve optimizing the code and implementing it on a digital signal processing (DSP) chip.&amp;nbsp;A patent application for the wavelet algorithm has been filed with the USPTO.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Benefits&lt;/strong&gt;&lt;/p&gt;&lt;ul&gt;&lt;li&gt;&lt;strong&gt;Improved efficiency&lt;/strong&gt;: Offers precision measurement only where it is needed rather than on the entire fiber&lt;/li&gt;&lt;li&gt;&lt;strong&gt;Faster signal processing&lt;/strong&gt;: Data can be processed at different resolutions at different fiber segments&lt;/li&gt;&lt;li&gt;&lt;strong&gt;Adaptive&lt;/strong&gt;: Automatically selects optimum resolution based on data received&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;&lt;strong&gt;Applications&lt;/strong&gt;&lt;/p&gt;&lt;ul&gt;&lt;li&gt;Strain sensing&lt;/li&gt;&lt;li&gt;Temperature measurements&lt;/li&gt;&lt;/ul&gt;

Tags: active, armstrong-flight-research-center, project
Organization: National Aeronautics and Space Administration