AndreaBozzo/ceres-open-data-index huggingface dataset:
Landsat Collection 2 Level-2

Landsat Collection 2 Level-2 [Science Products](https://www.usgs.gov/landsat-missions/landsat-collection-2-level-2-science-products), consisting of atmospherically corrected [surface reflectance](https://www.usgs.gov/landsat-missions/landsat-collection-2-surface-reflectance) and [surface temperature](https://www.usgs.gov/landsat-missions/landsat-collection-2-surface-temperature) image data. Collection 2 Level-2 Science Products are available from August 22, 1982 to present.

This dataset represents the global archive of Level-2 data from [Landsat Collection 2](https://www.usgs.gov/core-science-systems/nli/landsat/landsat-collection-2) acquired by the [Thematic Mapper](https://landsat.gsfc.nasa.gov/thematic-mapper/) onboard Landsat 4 and 5, the [Enhanced Thematic Mapper](https://landsat.gsfc.nasa.gov/the-enhanced-thematic-mapper-plus-etm/) onboard Landsat 7, and the [Operatational Land Imager](https://landsat.gsfc.nasa.gov/satellites/landsat-8/spacecraft-instruments/operational-land-imager/) and [Thermal Infrared Sensor](https://landsat.gsfc.nasa.gov/satellites/landsat-8/spacecraft-instruments/thermal-infrared-sensor/) onboard Landsat 8 and 9. Images are stored in [cloud-optimized GeoTIFF](https://www.cogeo.org/) format.
Harmonized Landsat Sentinel-2 (HLS) Version 2.0, Landsat Data

Harmonized Landsat Sentinel-2 (HLS) Version 2.0 provides consistent surface reflectance (SR)
and top of atmosphere (TOA) brightness data from the Operational Land Imager (OLI) aboard the
joint NASA/USGS Landsat 8 and Landsat 9 satellites and the Multi-Spectral Instrument (MSI)
aboard the ESA (European Space Agency) Sentinel-2A, Sentinel-2B, and Sentinel-2C satellites.
The combined measurement enables global observations of the land every 2-3 days at 30 meter
(m) spatial resolution. The HLS-S30 and HLS-L30 products are gridded to the same resolution and
Military Grid Reference System (MGRS) tiling system and are "stackable" for time series analysis.
This dataset is in the form of cloud-optimized GeoTIFFs. The HLS v2.0 data is generated by NASA's
IMPACT team at Marshall Space Flight Center. The product latency is 1.7 days, from the satellite
overpass to the HLS data availability at NASA's Land Processes Distributed Active Archive Center
(LP DAAC). For more information see LP DAAC's
[HLS Overview](https://lpdaac.usgs.gov/data/get-started-data/collection-overview/missions/harmonized-landsat-sentinel-2-hls-overview/).

This collection contains HLS data collected from Landsat-8 and Landsat-9.
HLS data generated from Sentinel-2 satellites can be found in a separate collection.
Sentinel-3 1-Day Surface Reflectance and NDVI (SPOT VEGETATION)

This Collection provides the Sentinel-3 [Synergy Level-2 1-Day Surface Reflectance and NDVI](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-vg1-v10) products, which are SPOT VEGETATION Continuity Products similar to those obtained from the [VEGETATION instrument](https://docs.terrascope.be/#/Satellites/SPOT-VGT/MissionInstruments) onboard the SPOT-4 and SPOT-5 satellites. The primary variables are a maximum Normalized Difference Vegetation Index (NDVI) composite, which is derived from daily ground reflecrtance, and four surface reflectance bands:

- B0 (Blue, 450nm)
- B2 (Red, 645nm)
- B3 (NIR, 835nm)
- MIR (SWIR, 1665nm)

The four reflectance bands have center wavelengths matching those on the original SPOT VEGETATION instrument. The NDVI variable, which is an indicator of the amount of vegetation, is derived from the B3 and B2 bands.

## Data files

The four reflectance bands and NDVI values are each contained in dedicated NetCDF files. Additional metadata are delivered in annotation NetCDF files, each containing a single variable, including the geometric viewing and illumination conditions, the total water vapour and ozone columns, and the aerosol optical depth.

Each 1-day product is delivered as a set of 10 rectangular scenes:

- AFRICA
- NORTH_AMERICA
- SOUTH_AMERICA
- CENTRAL_AMERICA
- NORTH_ASIA
- WEST_ASIA
- SOUTH_EAST_ASIA
- ASIAN_ISLANDS
- AUSTRALASIA
- EUROPE

More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-vg1-v10) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-synergy/vgt-s/vg1-product-surface-reflectance).

This Collection contains Level-2 data in NetCDF files from October 2018 to present.
Sentinel-3 Top of Atmosphere Reflectance (SPOT VEGETATION)

This Collection provides the Sentinel-3 [Synergy Level-2 Top of Atmosphere Reflectance](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-vgp) product, which is a SPOT VEGETATION Continuity Product containing measurement data similar to that obtained by the [VEGETATION instrument](https://docs.terrascope.be/#/Satellites/SPOT-VGT/MissionInstruments) onboad the SPOT-3 and SPOT-4 satellites. The primary variables are four top of atmosphere reflectance bands:

- B0 (Blue, 450nm)
- B2 (Red, 645nm)
- B3 (NIR, 835nm)
- MIR (SWIR, 1665nm)

The four reflectance bands have center wavelengths matching those on the original SPOT VEGETATION instrument and have been adapted for scientific applications requiring highly accurate physical measurements through correction for systematic errors and re-sampling to predefined geographic projections. The pixel brightness count is the ground area's apparent reflectance as seen at the top of atmosphere.

## Data files

NetCDF files are provided for the four reflectance bands. Additional metadata are delivered in annotation NetCDF files, each containing a single variable, including the geometric viewing and illumination conditions, the total water vapour and ozone columns, and the aerosol optical depth.

More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-vgp) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-synergy/level-2/vgt-p-product).

This Collection contains Level-2 data in NetCDF files from October 2018 to present.
Sentinel-3 Land Surface Reflectance and Aerosol

This Collection provides the Sentinel-3 [Synergy Level-2 Land Surface Reflectance and Aerosol](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-syn) product, which contains data on Surface Directional Reflectance, Aerosol Optical Thickness, and an Angstrom coefficient estimate over land.

## Data Files

Individual NetCDF files for the following variables:

- Surface Directional Reflectance (SDR) with their associated error estimates for the sun-reflective [SLSTR](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-slstr) channels (S1 to S6 for both nadir and oblique views, except S4) and for all [OLCI](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-olci) channels, except for the oxygen absorption bands Oa13, Oa14, Oa15, and the water vapor bands Oa19 and Oa20.
- Aerosol optical thickness at 550nm with error estimates.
- Angstrom coefficient at 550nm.

More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-syn) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-synergy/level-2/syn-level-2-product).

This Collection contains Level-2 data in NetCDF files from September 2018 to present.
Sentinel-3 Fire Radiative Power

This Collection provides Sentinel-3 [SLSTR Level-2 Fire Radiative Power](https://sentinel.esa.int/web/sentinel/user-guides/sentinel-3-slstr/product-types/level-2-frp) (FRP) products containing data on fires detected over land and ocean.

## Data files

The primary measurement data is contained in the `FRP_in.nc` file and provides FRP and uncertainties, projected onto a 1km grid, for fires detected in the thermal infrared (TIR) spectrum over land. Since February 2022, FRP and uncertainties are also provided for fires detected in the short wave infrared (SWIR) spectrum over both land and ocean, with the delivered data projected onto a 500m grid. The latter SWIR-detected fire data is only available for night-time measurements and is contained in the `FRP_an.nc` or `FRP_bn.nc` files.

In addition to the measurement data files, a standard set of annotation data files provide meteorological information, geolocation and time coordinates, geometry information, and quality flags.

## Processing

The TIR fire detection is based on measurements from the S7 and F1 bands of the [SLSTR instrument](https://sentinels.copernicus.eu/web/sentinel/technical-guides/sentinel-3-slstr/instrument); SWIR fire detection is based on the S5 and S6 bands. More information about the product and data processing can be found in the [User Guide](https://sentinel.esa.int/web/sentinel/user-guides/sentinel-3-slstr/product-types/level-2-frp) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-slstr/level-2/frp-processing).

This Collection contains Level-2 data in NetCDF files from August 2020 to present.
ESA WorldCover

The European Space Agency (ESA) [WorldCover](https://esa-worldcover.org/en) product provides global land cover maps for the years 2020 and 2021 at 10 meter resolution based on the combination of [Sentinel-1](https://sentinel.esa.int/web/sentinel/missions/sentinel-1) radar data and [Sentinel-2](https://sentinel.esa.int/web/sentinel/missions/sentinel-2) imagery. The discrete classification maps provide 11 classes defined using the Land Cover Classification System (LCCS) developed by the United Nations (UN) Food and Agriculture Organization (FAO). The map images are stored in [cloud-optimized GeoTIFF](https://www.cogeo.org/) format.

The WorldCover product is developed by a consortium of European service providers and research organizations. [VITO](https://remotesensing.vito.be/) (Belgium) is the prime contractor of the WorldCover consortium together with [Brockmann Consult](https://www.brockmann-consult.de/) (Germany), [CS SI](https://www.c-s.fr/) (France), [Gamma Remote Sensing AG](https://www.gamma-rs.ch/) (Switzerland), [International Institute for Applied Systems Analysis](https://www.iiasa.ac.at/) (Austria), and [Wageningen University](https://www.wur.nl/nl/Wageningen-University.htm) (The Netherlands).

Two versions of the WorldCover product are available:

- WorldCover 2020 produced using v100 of the algorithm
  - [WorldCover 2020 v100 User Manual](https://esa-worldcover.s3.eu-central-1.amazonaws.com/v100/2020/docs/WorldCover_PUM_V1.0.pdf)
  - [WorldCover 2020 v100 Validation Report](<https://esa-worldcover.s3.eu-central-1.amazonaws.com/v100/2020/docs/WorldCover_PVR_V1.1.pdf>)

- WorldCover 2021 produced using v200 of the algorithm
  - [WorldCover 2021 v200 User Manual](<https://esa-worldcover.s3.eu-central-1.amazonaws.com/v200/2021/docs/WorldCover_PUM_V2.0.pdf>)
  - [WorldCover 2021 v200 Validaton Report](<https://esa-worldcover.s3.eu-central-1.amazonaws.com/v200/2021/docs/WorldCover_PVR_V2.0.pdf>)

Since the WorldCover maps for 2020 and 2021 were generated with different algorithm versions (v100 and v200, respectively), changes between the maps include both changes in real land cover and changes due to the used algorithms.
Microsoft Building Footprints

Bing Maps is releasing open building footprints around the world. We have detected over 999 million buildings from Bing Maps imagery between 2014 and 2021 including Maxar and Airbus imagery. The data is freely available for download and use under ODbL. This dataset complements our other releases.

For more information, see the [GlobalMLBuildingFootprints](https://github.com/microsoft/GlobalMLBuildingFootprints/) repository on GitHub.

## Building footprint creation

The building extraction is done in two stages:

1. Semantic Segmentation – Recognizing building pixels on an aerial image using deep neural networks (DNNs)
2. Polygonization – Converting building pixel detections into polygons

**Stage 1: Semantic Segmentation**

![Semantic segmentation](https://raw.githubusercontent.com/microsoft/GlobalMLBuildingFootprints/main/images/segmentation.jpg)

**Stage 2: Polygonization**

![Polygonization](https://github.com/microsoft/GlobalMLBuildingFootprints/raw/main/images/polygonization.jpg)

## Data assets

The building footprints are provided as a set of [geoparquet](https://github.com/opengeospatial/geoparquet) datasets in [Delta][delta] table format.
The data are partitioned by

1. Region
2. quadkey at [Bing Map Tiles][tiles] level 9

Each `(Region, quadkey)` pair will have one or more geoparquet files, depending on the density of the of the buildings in that area.

Note that older items in this dataset are *not* spatially partitioned. We recommend using data with a processing date
of 2023-04-25 or newer. This processing date is part of the URL for each parquet file and is captured in the STAC metadata
for each item (see below).

## Delta Format

The collection-level asset under the `delta` key gives you the fsspec-style URL
to the Delta table. This can be used to efficiently query for matching partitions
by `Region` and `quadkey`. See the notebook for an example using Python.

## STAC metadata

This STAC collection has one STAC item per region. The `msbuildings:region`
property can be used to filter items to a specific region, and the `msbuildings:quadkey`
property can be used to filter items to a specific quadkey (though you can also search
by the `geometry`).

Note that older STAC items are not spatially partitioned. We recommend filtering on
items with an `msbuildings:processing-date` of `2023-04-25` or newer. See the collection
summary for `msbuildings:processing-date` for a list of valid values.

[delta]: https://delta.io/
[tiles]: https://learn.microsoft.com/en-us/bingmaps/articles/bing-maps-tile-system
Harmonized Landsat Sentinel-2 (HLS) Version 2.0, Sentinel-2 Data

Harmonized Landsat Sentinel-2 (HLS) Version 2.0 provides consistent surface reflectance (SR)
and top of atmosphere (TOA) brightness data from the Operational Land Imager (OLI) aboard the
joint NASA/USGS Landsat 8 and Landsat 9 satellites and the Multi-Spectral Instrument (MSI)
aboard the ESA (European Space Agency) Sentinel-2A, Sentinel-2B, and Sentinel-2C satellites.
The combined measurement enables global observations of the land every 2-3 days at 30 meter
(m) spatial resolution. The HLS-S30 and HLS-L30 products are gridded to the same resolution and
Military Grid Reference System (MGRS) tiling system and are "stackable" for time series analysis.
This dataset is in the form of cloud-optimized GeoTIFFs. The HLS v2.0 data is generated by NASA's
IMPACT team at Marshall Space Flight Center. The product latency is 1.7 days, from the satellite
overpass to the HLS data availability at NASA's Land Processes Distributed Active Archive Center
(LP DAAC). For more information see LP DAAC's
[HLS Overview](https://lpdaac.usgs.gov/data/get-started-data/collection-overview/missions/harmonized-landsat-sentinel-2-hls-overview/).

This collection contains HLS data collected from Sentinel-2A, Sentinel-2B, and Sentinel-2C.
HLS data generated from Landsat can be found in a separate collection.
Sentinel-3 Ocean Radar Altimetry

This Collection provides Sentinel-3 [SRAL Level-2 Ocean Altimetry](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-altimetry/level-2-algorithms-products) products, which contain data on ocean radar altimetry measurements. Each product contains three NetCDF files:

- A reduced data file containing a subset of the 1 Hz Ku-band parameters.
- A standard data file containing the standard 1 Hz and 20 Hz Ku- and C-band parameters.
- An enhanced data file containing the standard 1 Hz and 20 Hz Ku- and C-band parameters along with the waveforms and parameters necessary to reprocess the data.

More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-altimetry/overview) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-altimetry).

This Collection contains Level-2 data in NetCDF files from January 2017 to present.
Sentinel-3 Sea Surface Temperature

This Collection provides Sentinel-3 [SLSTR Level-2 Water Surface Temperature](https://sentinel.esa.int/web/sentinel/user-guides/sentinel-3-slstr/product-types/level-2-wst) products containing data on sea surface temperature measurements on a 1km grid. Each product consists of a single NetCDF file containing all data variables:

- Sea Surface Temperature (SST) value
- SST total uncertainty
- Latitude and longitude coordinates
- SST time deviation
- Single Sensor Error Statistic (SSES) bias and standard deviation estimate
- Contextual parameters such as wind speed at 10 m and fractional sea-ice contamination
- Quality flag
- Satellite zenith angle
- Top Of Atmosphere (TOA) Brightness Temperature (BT)
- TOA noise equivalent BT

More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-slstr/product-types/level-2-wst) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-slstr/level-2/sst-processing).

This Collection contains Level-2 data in NetCDF files from October 2017 to present.
Sentinel-3 Land Surface Temperature

This Collection provides Sentinel-3 [SLSTR Level-2 Land Surface Temperature](https://sentinel.esa.int/web/sentinel/user-guides/sentinel-3-slstr/product-types/level-2-lst) products containing data on land surface temperature measurements on a 1km grid. Radiance is measured in two channels to determine the temperature of the Earth's surface skin in the instrument field of view, where the term "skin" refers to the top surface of bare soil or the effective emitting temperature of vegetation canopies as viewed from above.

## Data files

The dataset includes data on the primary measurement variable, land surface temperature, in a single NetCDF file, `LST_in.nc`. A second file, `LST_ancillary.nc`, contains several ancillary variables:

- Normalized Difference Vegetation Index
- Surface biome classification
- Fractional vegetation cover
- Total water vapor column

In addition to the primary and ancillary data files, a standard set of annotation data files provide meteorological information, geolocation and time coordinates, geometry information, and quality flags. More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-slstr/product-types/level-2-lst) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-slstr/level-2/lst-processing).

This Collection contains Level-2 data in NetCDF files from April 2016 to present.

## STAC Item geometries

The Collection contains small "chips" and long "stripes" of data collected along the satellite direction of travel. Approximately five percent of the STAC Items describing long stripes of data contain geometries that encompass a larger area than an exact concave hull of the data extents. This may require additional filtering when searching the Collection for Items that spatially intersect an area of interest.
Sentinel-3 Land Radar Altimetry

This Collection provides Sentinel-3 [SRAL Level-2 Land Altimetry](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-altimetry/level-2-algorithms-products) products, which contain data on land radar altimetry measurements. Each product contains three NetCDF files:

- A reduced data file containing a subset of the 1 Hz Ku-band parameters.
- A standard data file containing the standard 1 Hz and 20 Hz Ku- and C-band parameters.
- An enhanced data file containing the standard 1 Hz and 20 Hz Ku- and C-band parameters along with the waveforms and parameters necessary to reprocess the data.

More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-altimetry/overview) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-altimetry).

This Collection contains Level-2 data in NetCDF files from March 2016 to present.
Sentinel-3 Land (Full Resolution)

This collection provides Sentinel-3 Full Resolution [OLCI Level-2 Land][olci-l2] products containing data on global vegetation, chlorophyll, and water vapor.

## Data files

This dataset includes data on three primary variables:

* OLCI global vegetation index file
* terrestrial Chlorophyll index file
* integrated water vapor over water file.

Each variable is contained within a separate NetCDF file, and is cataloged as an asset in each Item.

Several associated variables are also provided in the annotations data files:

* rectified reflectance for red and NIR channels (RC681 and RC865)
* classification, quality and science flags (LQSF)
* common data such as the ortho-geolocation of land pixels, solar and satellite angles, atmospheric and meteorological data, time stamp or instrument information. These variables are inherited from Level-1B products.

This full resolution product offers a spatial sampling of approximately 300 m.

## Processing overview

The values in the data files have been converted from Top of Atmosphere radiance to reflectance, and include various corrections for gaseous absorption and pixel classification. More information about the product and data processing can be found in the [User Guide](https://sentinel.esa.int/web/sentinel/user-guides/sentinel-3-olci/product-types/level-2-land) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-olci/level-2/processing).

This Collection contains Level-2 data in NetCDF files from April 2016 to present.

[olci-l2]: https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-olci/level-2/land-products
Sentinel-3 10-Day Surface Reflectance and NDVI (SPOT VEGETATION)

This Collection provides the Sentinel-3 [Synergy Level-2 10-Day Surface Reflectance and NDVI](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-vg1-v10) products, which are SPOT VEGETATION Continuity Products similar to those obtained from the [VEGETATION instrument](https://docs.terrascope.be/#/Satellites/SPOT-VGT/MissionInstruments) onboard the SPOT-4 and SPOT-5 satellites. The primary variables are a maximum Normalized Difference Vegetation Index (NDVI) composite, which is derived from ground reflectance during a 10-day window, and four surface reflectance bands:

- B0 (Blue, 450nm)
- B2 (Red, 645nm)
- B3 (NIR, 835nm)
- MIR (SWIR, 1665nm)

The four reflectance bands have center wavelengths matching those on the original SPOT VEGETATION instrument. The NDVI variable, which is an indicator of the amount of vegetation, is derived from the B3 and B2 bands.

## Data files

The four reflectance bands and NDVI values are each contained in dedicated NetCDF files. Additional metadata are delivered in annotation NetCDF files, each containing a single variable, including the geometric viewing and illumination conditions, the total water vapour and ozone columns, and the aerosol optical depth.

Each 10-day product is delivered as a set of 10 rectangular scenes:

- AFRICA
- NORTH_AMERICA
- SOUTH_AMERICA
- CENTRAL_AMERICA
- NORTH_ASIA
- WEST_ASIA
- SOUTH_EAST_ASIA
- ASIAN_ISLANDS
- AUSTRALASIA
- EUROPE

More information about the product and data processing can be found in the [User Guide](https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-3-synergy/product-types/level-2-vg1-v10) and [Technical Guide](https://sentinel.esa.int/web/sentinel/technical-guides/sentinel-3-synergy/vgt-s/v10-product).

This Collection contains Level-2 data in NetCDF files from September 2018 to present.