AndreaBozzo/ceres-open-data-index huggingface dataset:
National Estuarine Research Reserve System - NERRS - Nutrient and Pigment Data

Water quality observations made over long time periods can provide important feedback to scientists and to local, state, and national resource managers about actions taken to manage, protect, and restore estuaries. They also provide valuable information for evaluating the impacts of environmental change on coastal habitats and species. There are at least four water quality stations at each National Estuarine Research Reserve. Each station is designed to characterize long-term variability and short term changes in environmental conditions. Discrete samples for nutrient and chlorophyll a concentrations are collected at each long-term monitoring station at least once monthly. More intensive (24-hours over a complete tidal cycle) sampling is conducted each month at one water quality monitoring station to better understand impacts of tide and irradiance on nutrient cycling. Nutrient parameters collected include: nitrate, nitrite, ammonium, orthophosphate, and chlorophyll a. Numerous optional parameters include dissolved organic carbon, total dissolved nitrogen, and total dissolved phosphorous. The National Estuarine Research Reserves is a network of 30 reserves protected for long-term research, ecosystem monitoring, education, and coastal stewardship. Established by the Coastal Zone Management Act, the reserve system is a partnership program between NOAA and the coastal states. NOAA provides funding, national guidance, and technical assistance. Each reserve is managed on daily basis by a lead state agency or university with input from local partners. These data are collected as part of the NERRS System-Wide Monitoring Program (SWMP), which includes (1) abiotic indicators of water quality and weather; (2) biological monitoring; and (3) watershed, habitat, and land use mapping. Data were collected under individual Reserve NOAA grant/cooperative agreements and managed by the CDMO under NOAA grant/cooperative agreement #NA24NOSX420C0061-T1-01 (2024) and prior grants. For more information on Reserve locations and programs, please visit www.nerrsdata.org or https://coast.noaa.gov/nerrs/.

Tags: alabama, alaska, ammonia, atlantic ocean, biosphere, california, caribbean sea, central pacific ocean, coastal, connecticut, continent, delaware, doc/noaa/nos/ocm, earth science, ecosystems, estuary, florida, georgia, great lakes, gulf of alaska, gulf of america, hawaii, hawaiian islands, maine, mangrove swamp, marine ecosystems, maryland, massachusetts, mississippi, national ocean service, nerrs, new hampshire, new jersey, new york, nitrate, nitrite, noaa, north america, north atlantic ocean, north carolina, north pacific ocean, ocean, ocean chemistry, oceans, office of coastal management, ohio, pacific ocean, phosphate, pigments, rhode island, salt marsh, south carolina, terrestrial hydrosphere, texas, u.s. department of commerce, united states of america, virginia, washington, water quality/water chemistry, wisconsin
Organization: National Oceanic and Atmospheric Administration, Department of Commerce
2023 NYS Lidar: Lake Ontario Shoreline, NY

Original Dataset Product: These lidar data are processed Classified LAS 1.4 files, formatted to 2690 individual 1500 m x 1500 m tiles; used to create intensity rasters, 3D breaklines and hydro-flattened DEMs as necessary.
Original Dataset Geographic Extent: Cayuga, Jefferson, Lewis, Orleans, Oswego, St. Lawrence, and Wayne Counties counties, New York, covering approximately 2337 square miles. 

Original Dataset Description: The lidar project called for the Planning, Acquisition, processing and derivative products of lidar data to be collected at a nominal pulse spacing (NPS) of 0.7 meters. Project specifications are based on the U.S. Geological Survey National Geospatial Program Base Lidar Specification v2023, Rev. A. The data was developed based on a horizontal projection/datum of NAD83 (2011), Universal Transverse Mercator, meters and vertical datum of NAVD88 (GEOID18), meters. Lidar data was delivered as flightline-extent unclassified LAS swaths and as processed Classified LAS 1.4 files, formatted to 2690 individual 1500 m x 1500 m tiles, as tiled Intensity Rasters, and as tiled bare-earth DEMs; all tiled to the same 1500 m x 1500 m schema.

Ground Conditions: Lidar was collected in spring 2023, while no snow was on the ground and rivers were at or below normal levels. In order to post process the lidar data to meet task order specifications and meet ASPRS vertical accuracy guidelines, Sanborn Map Company, Inc., established a total of 28 ground control points that were used to calibrate the lidar to known ground locations established throughout the project area. An additional 150 independent accuracy checkpoints, 84 in Bare Earth and Urban landcovers (84 NVA points), 66 in Tall Grass and Brushland/Low Trees categories (66 VVA points), were used to assess the vertical accuracy of the data. These check points were not used to calibrate or post process the data.

This dataset was downloaded by the NOAA Office for Coastal Management (OCM) from the New York State GIS Clearinghouse to make the data available for bulk and custom downloads from the NOAA Digital Coast Data Access Viewer.

Tags: airplane, coastal elevation, coastal processes, continent, doc/noaa/nos/ocm, earth science, land surface, lidar, light detection and ranging, national ocean service, new york, noaa, north america, oceans, office of coastal management, terrain elevation, topography, u.s. department of commerce, united states of america, vertical location
Organization: National Oceanic and Atmospheric Administration, Department of Commerce
Virtual Sensors: Efficiently Estimating Missing Spectra

Various instruments are used to create images of the Earth and other objects in the universe in a diverse set of wavelength bands with the aim of understanding natural phenomena. Sometimes these instruments are built in a phased approach, with additional measurement capabilities added in later phases. In other cases, technology may mature to the point that the instrument offers new measurement capabilities that were not planned in the original design of the instrument. In still other cases, high resolution spectral measurements may be too costly to perform on a large sample and therefore lower resolution spectral instruments are used to take the majority of measurements. Many applied science questions that are relevant to the earth science remote sensing community require analysis of enormous amounts of data that were generated by instruments with disparate measurement capabilities. This paper addresses this problem using Virtual Sensors: a method that uses modelstrained on spectrally rich (high spectral resolution) data to "fill in" unmeasured spectral channels in spectrally poor (low spectral resolution) data. The models we use in this paper are Multi-Layer Perceptrons (MLPs), Support Vector Machines (SVMs) with Radial Basis Function (RBF) kernels and SVMs with Mixture Density Mercer Kernels (MDMK). We demonstrate this method by using models trained on the high spectral resolution Terra MODIS instrument to estimate what the equivalent of the MODIS 1.6 micron channel would be for the NOAA AVHRR/2 instrument. The scientific motivation for the simulation of the 1.6 micron channel is to improve the ability of the AVHRR/2 sensor to detect clouds over snow and ice.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
UARS Solar Ultraviolet Spectral Irradiance Monitor (SUSIM) Level 3BS V022 (UARSU3BS) at GES DISC

The Solar Ultraviolet Spectral Irradiance Monitor (SUSIM) Level 3BS data product consists of daily, 1 nm resolution, solar spectral irradiances and selected solar parameters. The instrument consisted of two identical double-dispersion scanning spectrometers, seven detectors (5 photodiodes, 2 photon counters), and solar ultraviolet calibration sources measuring in the wavelength range from 110 to 410 nm. One spectrometer measured the solar disk while the other was for calibration using high-precision deuterium lamps calibrated by NIST. SUSIM was flown on NASA's Upper Atmosphere Research Satellite (UARS) and designed to measure the full disk solar irradiance with high precision and accuracy to follow short-term (minutes to hours), intermediate-term (days to weeks), and long-term (11 year sunspot, and 22 year solar magnetic field cycles) variations in the solar output. The SUSIM Level 3BS data were processed with the version 22 algorithm.

The SUSIM Level 3BS data consists of 1 granule per day. The data are normalized to an earth-sun distance of 1 AU, and instrument degradation have been applied to the data. Included with the primary solar spectral irradiance values are the following solar indices: Lyman alpha, O-I (130 nm), C-II (134 nm) and C-IV (155 nm), Al Edge, and core-wing ratios of Mg-I and Mg-II. The data files are available in a binary record oriented format.

Tags: earth-science, solar-activity, sun-earth-interactions
Organization: National Aeronautics and Space Administration
GPM GROUND VALIDATION NOAA UHF 449 PROFILER MC3E V1

The GPM Ground Validation NOAA UHF 449 Profiler MC3E dataset was collected during the NASA supported Midlatitude Continental Convective Clouds Experiment (MC3E). The overarching goal was to provide the most complete characterization of convective cloud systems, precipitation, and the environment that has ever been obtained, providing constraints for model cumulus parameterizations and space-based rainfall retrieval algorithms over land that had never before been available. The Ultra High Frequency 449 MHz profiler was one of three NOAA deployed instruments which also included a Parsivel and a 2.8 GHz profiler (S-Band). The 449 MHz profiler raw data files provide estimates of the vertical air motion during precipitation from near the surface to just below the freezing level. Used together with the S-band profiler, vertical profiles of raindrop size distributions can be retrieved. The raw 449MGx profiler data consists of uncalibrated Doppler velocity spectra data in units of relative power return.

Tags: atmosphere, atmospheric-winds, earth-science, radar, spectral-engineering
Organization: National Aeronautics and Space Administration
Ground-Based Global Navigation Satellite System (GNSS) Observation Data (1-second sampling, sub-hourly files) from NASA CDDIS

This dataset consists of ground-based Global Navigation Satellite System (GNSS) Observation Data (1-second sampling, sub-hourly files) from the NASA Crustal Dynamics Data Information System (CDDIS). GNSS provide autonomous geo-spatial positioning with global coverage. GNSS data sets from ground receivers at the CDDIS consist primarily of the data from the U.S. Global Positioning System (GPS) and the Russian GLObal NAvigation Satellite System (GLONASS). Since 2011, the CDDIS GNSS archive includes data from other GNSS (Europe’s Galileo, China’s Beidou, Japan’s Quasi-Zenith Satellite System/QZSS, the Indian Regional Navigation Satellite System/IRNSS, and worldwide Satellite Based Augmentation Systems/SBASs), which are similar to the U.S. GPS in terms of the satellite constellation, orbits, and signal structure. The sub-hourly GNSS observation files (un-compacted) contain 15 minutes of GPS or multi-GNSS observation (1-second sampling) data in RINEX format from a global permanent network of ground-based receivers, one file per 15 minutes per site. More information about these data is available on the CDDIS website at https://cddis.nasa.gov/Data_and_Derived_Products/GNSS/high-rate_data.html.

Tags: earth-science, geodetics, gravity-gravitational-field, solid-earth, tectonics
Organization: National Aeronautics and Space Administration
THIR/Nimbus-6 Level 1 Meteorological Radiation Data at 6.7 microns V001 (THIRN6L1CH67) at GES DISC

THIRN6L1CH67 is the Nimbus-6 Temperature-Humidity Infrared Radiometer (THIR) Level 1 Meteorological Radiation Data at 6.7 microns product and contains radiances expressed in units of equivalent brightness temperature measured in the 6.7 micron (water vapor) channel. The data, originally written on IBM 360 machines, were recovered from magnetic tapes, also referred to as Nimbus Meteorological Radiation Tapes (NMRT-THIR). The data are archived in their original IBM 36-bit word proprietary format, also referred to as a binary TAP file.

The Nimbus-6 satellite was successfully launched on June 18, 1975. The Temperature-Humidity Infrared Radiometer (THIR) experiment on Nimbus-6 continues the measurements made by its predecessors flown on Nimbus-4 and Nimbus-5. The THIR instrument is a two channel high resolution scanning radiometer designed to perform two major functions:

1) The 11.5-12.5 micron channel provides both day and night cloud top or surface temperatures, with a resolution at nadir of 8 km, and operates day and night.
2) The 6.7 micron channel gives information on the water vapor content of the upper troposphere and stratosphere and the location of jet streams and frontal systems, with a resolution at nadir of 22 km, and operates mostly at night.

The THIR Principal Investigator was Andrew W. McCulloch from NASA Goddard Space Flight Center. This product was previously available from the NSSDC with the identifier ESAD-00164 (old ID 75-052A-12D).

Tags: earth-science, infrared-wavelengths, spectral-engineering
Organization: National Aeronautics and Space Administration
High Mountain Asia GFDL FLOR Modeled Extreme Precipitation Indices V001

This data set features seven standard annual mean extreme precipitation indices: Rx1day, Rx5day, CWD, R10mm, R20mm, R95pTOT, and R99pTOT. They were selected on the basis of potential relevance to landslide activity from the 27 indices established by the joint CCl/CLIVAR/JCOMM Expert Team (ET) on Climate Change Detection and Indices (ETCCDI). The seven indices were simulated by the National Oceanic and Atmospheric Administration (NOAA) Geophysical Fluid Dynamics Laboratory (GFDL) Forecast-oriented Low Ocean Resolution version of CM2.5 (GFDL FLOR).

Tags: atmospheric-ocean-indicators, climate-indicators, earth-science
Organization: National Aeronautics and Space Administration
Draper Clock-Synchronization Protocol in SAL

In 1973, Daly, Hpokins, and McKenna (from Draper Lab.) presented a fault-tolerant digital clocking system at the FTCS conference. This is probably one of the first published system designs that is intended to tolerate arbitrary, asymmetric faults (i.e., Byzantine faults).

The following SAL models (05/14/2012) are two variant formalizations of this Draper Clock-Synchronization Protocol developed by Ashish Tiwari.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
UARS PEM Level 2 VMAG AC V001 (UARPE2VMAGAC) at GES DISC

The Particle Environment Monitor (PEM) level 2 Vector Magnetometer (VMAG) AC daily product contains the Vector Magnetic Field AC component. PEM was flown on the UARS spacecraft to measure the type, amount, energy, and distribution of charged particles injected into the Earth's thermosphere, mesosphere, and stratosphere.

The VMAG DC magnetic field measurements are limited to frequencies less than 2.5 Hz by an 18 db/octave antialiasing filter. Higher frequencies are measured with a peak detector and are the Vector Magnetic Field AC component. The AC value is derived from each vector field component where the sensor output is pass band filtered from 2.5 to 50 Hz. The resultant signal is then half wave rectified and passed to an RC circuit with a time constant of 4.7 s. The voltage across the RC circuit is the peak detector output which therefore represents the peak positive amplitude of the 2.5-50 Hz filtered sensor output occurring during the previous 5 seconds; however, the peak detector is determined at a rate of about every second (the VMAG AC data has been adjusted for this time offset). The X and Z peak detectors have full scale of 1oo nT peak to peak (= 5 Volts) and the Y peak detector has a full scale of 10 nT peak to peak (= 5 Volts). The analog 0 to 5 Volts peak detector outputs are sent directly to the PEM central electronics package where they are digitized into a 265 binary word. This is the raw value in the data. No in-flight calibration of the AC peak detection electronics is provided. The VMAG unit is located on the zenith boom of UARS.

There is one data file per day for the PEM VMAG AC product, and the temporal coverage is from Oct. 1, 1991 to Aug. 23, 2005. Spatial coverage for the VMAG AC product ranges between -57 and +57 degrees latitude. The VMAG AC data files are written in network binary format. For more information please review the PEM VMAG AC data format guide.

Tags: earth-science, ionosphere-magnetosphere-dynamics, sun-earth-interactions
Organization: National Aeronautics and Space Administration
Amazon Web Services: Landsat GLS (Global Land Survey)

In the past, the U.S. Geological Survey (USGS) and NASA collaborated on the creation of four global land data sets from Landsat images: one from the 1970s, and one each from circa 1990, 2000, and 2005. Each of these global data sets was created from the primary Landsat sensor in use at the time: the Multispectral Scanner (MSS) in the 1970s, the Thematic Mapper (TM) in 1990, Enhanced Thematic Mapper Plus (ETM+) in 2000, and a combination of TM and ETM+ in 2005.

Tags: amazon-web-services, aws, climate, earth-science, landsat
Organization: National Aeronautics and Space Administration
Behavioral Health Barometer: Region 6, Volume 6

This is a behavioral health report for HHS Region VI of the United States and utilizes data from the National Survey on Drug Use and Health (NSDUH) and the National Survey of Substance Abuse Treatment (N-SSATS), collected annually. The topics addressed in the reports include youth substance use, youth mental health and treatment, adult mental health, substance use and substance use treatment.

Tags: behavioral-health, mental-health, region-6, samhsa, substance-use
Organization: U.S. Department of Health & Human Services
Aqua MODIS Level-2 Regional 11µm Day/Night Sea Surface Temperature (SST) - Near Real-time (NRT) Data, version R2019.0

The Ocean Biology DAAC produces near real-time (quicklook) products using the best-available combination of ancillary data from meteorological and ozone data. As such, the inputs and the calibration used are less than optimal. Quicklook products provide a snapshot of the data during a short time period within a single orbit.

Tags: earth-science, national-geospatial-data-asset, ngda, ocean-temperature, oceans
Organization: National Aeronautics and Space Administration
SMAP L2 Radar Half-Orbit 3 km EASE-Grid Soil Moisture V003

This Level-2 (L2) soil moisture product provides estimates of global land surface conditions retrieved by the Soil Moisture Active Passive (SMAP) active radar during 6:00 a.m. descending half-orbit passes, as well as ancillary data such as surface temperature and vegetation water content. Input backscatter data used to derive soil moisture are resampled to an Earth-fixed, global, cylindrical 3 km Equal-Area Scalable Earth Grid, Version 2.0 (EASE-Grid 2.0).

Tags: earth-science, land-surface, radar, soils, spectral-engineering
Organization: National Aeronautics and Space Administration
All CGP Records (MARC UTF-8)

The U.S. Government Publishing Office (GPO) makes available an annual snapshot of all MARC bibliographic records in the Catalog of U.S. Government Publications (CGP) in this GitHub repository. The CGP is the U.S. Government Publishing Office's (GPO) finding tool for electronic and print publications from the legislative, executive, and judicial branches of the U.S. Federal Government. These publications comprise the National Bibliography of U.S. Government Publications.

Tags: cataloging-and-indexing-program, cataloging-of-government-publications, classification, electronic-government-information, fdlp, federal-depository-library-program, government-publications, gpo, machine-readable-bibliographic-data, united-states-government-publishing-office
Organization: Government Publishing Office (GPO)
Multiple Kernel Learning for Heterogeneous Anomaly Detection: Algorithm and Aviation Safety Case Study

The world-wide aviation system is one of the most complex dynamical systems ever developed and is generating data at an extremely rapid rate. Most modern commercial aircraft record several hundred flight parameters including information from the guidance, navigation, and control systems, the avionics and propulsion systems, and the pilot inputs into the aircraft. These parameters may be continuous measurements or binary or categorical measurements recorded in one second intervals for the duration of the flight. Currently, most approaches to aviation safety are reactive, meaning that they are designed to react to an aviation safety incident or accident. In this paper, we discuss a novel approach based on the theory of multiple kernel learning to detect potential safety anomalies in very large data bases of discrete and continuous data from world-wide operations of commercial fleets. We pose a general anomaly detection problem which includes both discrete and continuous data streams, where we assume that the discrete streams have a causal influence on the continuous streams. We also assume that atypical sequences of events in the discrete streams can lead to off-nominal system performance. We discuss the application domain, novel algorithms, and also discuss results on real-world data sets. Our algorithm uncovers operationally significant events in high dimensional data streams in the
aviation industry which are not detectable using state of the art methods.

Tags: ames, dashlink, nasa
Organization: National Aeronautics and Space Administration
BUV/Nimbus-4 Dark Current Study Master Data V001 (BUVN4L1DCM) at GES DISC

The Nimbus-4 BUV Level-1 Dark Current Study Master Data is derived from the BUV Level 1 Radiance (RUT) product and contains the geophysical indices and classification, geographic and geomagnetic coordinates, solar magnetic parameters and angles; monochromator and photometer pulse count and analog data, and energetic trapped particles. There is one-to-one correspondence between this product and the dark current working data files, the difference is the working product data have been filtered.

The data were originally created on IBM 360 machines and archived on magnetic tapes. The data have been restored from the tapes and are now archived on disk in their original IBM binary file format. Each file contains about one orbit of data from the nighttime descending node. The data files consist of 140 4-byte word records which are blocked with up to 25 records. The average size of an orbit file is 480 kB.

This product was previously available from the NSSDC with the identifier ESAC-00045 (old ID 70-025A-05H).

Tags: earth-science, spectral-engineering, ultraviolet-wavelengths
Organization: National Aeronautics and Space Administration