AndreaBozzo/ceres-open-data-index huggingface dataset:
Radar - ESRL Wind Profiler with RASS, Condon - Raw Data

**Overview**

**Winds**
A radar wind profiler measures the Doppler shift of electromagnetic energy scattered back from atmospheric turbulence and hydrometeors along 3-5 vertical and off-vertical point beam directions. Back-scattered signal strength and radial-component velocities are remotely sensed along all beam directions and  combined to derive the horizontal wind field over the radar. These data typically are sampled and averaged hourly and usually have 6-m and/or 100-m vertical resolutions up to 4 km for the 915 MHz and 8 km for the 449 MHz systems. 

**Temperature**
To measure atmospheric temperature, a radio acoustic sound system (RASS) is used in conjunction with the wind profile. These data typically are sampled and averaged for five minutes each hour and have a 60-m vertical resolution up to 1.5 km for the 915 MHz and 60-m up to 3.5k m for the 449 MHz.

**Data Quality**

Various quality control (QC) algorithms developed over the years process data in real time on the radar software layer. These algorithms, which run in real time, act on time-series, spectra, moment, and consensus data layers that are persisted in various forms. For a detailed description, refer to the attached QC document: *915 and 449 MHz Radar Wind Profilers and RASS QC*. 

Tags: 00, a2e, atmosphere-to-electrons, eere, esrl-wind-profiler-with-rass-condon, radar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z06
Organization: Department of Energy
Radar - ARL Wind Profilerwith RASS, Boardman - Raw Data

**Overview**

**Winds**
A radar wind profiler measures the Doppler shift of electromagnetic energy scattered back from atmospheric turbulence and hydrometeors along 3-5 vertical and off-vertical point beam directions. Back-scattered signal strength and radial-component velocities are remotely sensed along all beam directions and  combined to derive the horizontal wind field over the radar. These data typically are sampled and averaged hourly and usually have 6-m and/or 100-m vertical resolutions up to 4 km for the 915 MHz and 8 km for the 449 MHz systems. 

**Temperature**
To measure atmospheric temperature, a radio acoustic sound system (RASS) is used in conjunction with the wind profile. These data typically are sampled and averaged for five minutes each hour and have a 60-m vertical resolution up to 1.5 km for the 915 MHz and 60-m up to 3.5k m for the 449 MHz.

**Data Quality**

Various quality control (QC) algorithms developed over the years process data in real time on the radar software layer. These algorithms, which run in real time, act on time-series, spectra, moment, and consensus data layers that are persisted in various forms. For a detailed description, refer to the attached QC document: *915 and 449 MHz Radar Wind Profilers and RASS QC*. 

Tags: 00, a2e, arl-wind-profilerwith-rass-boardman, atmosphere-to-electrons, eere, radar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z07
Organization: Department of Energy
Radar - ANL Wind Profiler, Walla Walla - Raw Data

**Overview**

**Winds**
A radar wind profiler measures the Doppler shift of electromagnetic energy scattered back from atmospheric turbulence and hydrometeors along 3-5 vertical and off-vertical point beam directions. Back-scattered signal strength and radial-component velocities are remotely sensed along all beam directions and  combined to derive the horizontal wind field over the radar. These data typically are sampled and averaged hourly and usually have 6-m and/or 100-m vertical resolutions up to 4 km for the 915 MHz and 8 km for the 449 MHz systems. 

**Temperature**
To measure atmospheric temperature, a radio acoustic sound system (RASS) is used in conjunction with the wind profile. These data typically are sampled and averaged for five minutes each hour and have a 60-m vertical resolution up to 1.5 km for the 915 MHz and 60-m up to 3.5k m for the 449 MHz.

**Data Details**

Spectra data are stored in two daily files, a header (file names contain "H") and a data (file names contain "D") file. The (H)eader files are made up of binary data records containing information about the operational parameters of the profiler, while (D)ata files, also composed of binary data records, contain the spectra data collected by the profiler, i.e. spectral values for each spectral bin for every range gate. 

**Data Quality**

Various quality control (QC) algorithms developed over the years process data in real time on the radar software layer. These algorithms, which run in real time, act on time-series, spectra, moment, and consensus data layers that are persisted in various forms. For a detailed description, refer to the attached QC document: *915 and 449 MHz Radar Wind Profilers and RASS QC*. 

**Uncertainty**

The uncertainty is defined by the spacing of the spectral bin.

Tags: 00, a2e, anl-wind-profiler-walla-walla, atmosphere-to-electrons, eere, radar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z08
Organization: Department of Energy
Radar - ANL Wind Profiler with RASS, Yakima - Raw Data

**Overview**

**Winds**
A radar wind profiler measures the Doppler shift of electromagnetic energy scattered back from atmospheric turbulence and hydrometeors along 3-5 vertical and off-vertical point beam directions. Back-scattered signal strength and radial-component velocities are remotely sensed along all beam directions and  combined to derive the horizontal wind field over the radar. These data typically are sampled and averaged hourly and usually have 6-m and/or 100-m vertical resolutions up to 4 km for the 915 MHz and 8 km for the 449 MHz systems. 

**Temperature**
To measure atmospheric temperature, a radio acoustic sound system (RASS) is used in conjunction with the wind profile. These data typically are sampled and averaged for five minutes each hour and have a 60-m vertical resolution up to 1.5 km for the 915 MHz and 60-m up to 3.5k m for the 449 MHz.

**Data Details**

Spectra data are stored in two daily files, a header (file names contain "H") and a data (file names contain "D") file. The (H)eader files are made up of binary data records containing information about the operational parameters of the profiler, while (D)ata files, also composed of binary data records, contain the spectra data collected by the profiler, i.e. spectral values for each spectral bin for every range gate. 

**Data Quality**

Various quality control (QC) algorithms developed over the years process data in real time on the radar software layer. These algorithms, which run in real time, act on time-series, spectra, moment, and consensus data layers that are persisted in various forms. For a detailed description, refer to the attached QC document: *915 and 449 MHz Radar Wind Profilers and RASS QC*. 

**Uncertainty**

The uncertainty is defined by the spacing of the spectral bin.

Tags: 00, a2e, anl-wind-profiler-with-rass-yakima, atmosphere-to-electrons, eere, radar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z05
Organization: Department of Energy
Radar - ANL Wind Profiler with RASS, Goldendale - Raw Data

**Overview**

**Winds**
A radar wind profiler measures the Doppler shift of electromagnetic energy scattered back from atmospheric turbulence and hydrometeors along 3-5 vertical and off-vertical point beam directions. Back-scattered signal strength and radial-component velocities are remotely sensed along all beam directions and  combined to derive the horizontal wind field over the radar. These data typically are sampled and averaged hourly and usually have 6-m and/or 100-m vertical resolutions up to 4 km for the 915 MHz and 8 km for the 449 MHz systems. 

**Temperature**
To measure atmospheric temperature, a radio acoustic sound system (RASS) is used in conjunction with the wind profile. These data typically are sampled and averaged for five minutes each hour and have a 60-m vertical resolution up to 1.5 km for the 915 MHz and 60-m up to 3.5k m for the 449 MHz.

**Data Details**

Spectra data are stored in two daily files, a header (file names contain "H") and a data (file names contain "D") file. The (H)eader files are made up of binary data records containing information about the operational parameters of the profiler, while (D)ata files, also composed of binary data records, contain the spectra data collected by the profiler, i.e. spectral values for each spectral bin for every range gate. 

**Data Quality**

Various quality control (QC) algorithms developed over the years process data in real time on the radar software layer. These algorithms, which run in real time, act on time-series, spectra, moment, and consensus data layers that are persisted in various forms. For a detailed description, refer to the attached QC document: *915 and 449 MHz Radar Wind Profilers and RASS QC*. 

**Uncertainty**

The uncertainty is defined by the spacing of the spectral bin.

Tags: 00, a2e, anl-wind-profiler-with-rass-goldendale, atmosphere-to-electrons, eere, radar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z02
Organization: Department of Energy
Microwave Radiometer - UND Radiometrics MWR, Rufus - Reviewed Data

**Overview**

Reviewed dataset that also includes post-reprocessed level1 and level2 data files from November 2015 to May 2016 (refer to "Additional Information"). 

Monitor real-time profiles of temperature (K), water vapor (gm-3), relative humidity (%), and liquid water (gm-3) up to 10 km.

**Data Details**

A detailed overview of the mwr data already is associated to mwr.z03 and the raw dataset mwr.z02.00.

Because it was not possible to perform the LN2 calibration at the time of the deployment (November 2015), the University of Notre Dame team has post-reprocessed the level0 files (where the brightness temperatures are saved) with information from the LN2 calibration performed in May 2016 to re-retrieve the atmospheric profiles saved in the Level 2 files from November 2015 to May 2016. 

Therefore, the present dataset contains the post-reprocessed level1 and level2 data files from November 2015 to May 2016. After May 05, 2016, no post-reprocessing was needed. 

**IMPORTANT 1**: Due to the IRT sensor failure on December 09, 2016, data do not have reliable liquid water profiles and cloud information since December 09, 2016. The IRT failure does **not** affect temperature, relative humidity, and water vapor profiles. 

**IMPORTANT 2**: Because of a bug in the Radiometrics reprocessing software, the first two profiles in each of the post-reprocessed Level 2 data files from November 2015 to May 2016 should be discarded. A new version of the data will be provided if and when Radiometrics provides a new version of the software.  

**Data Quality**

Same as for mwr.z03.

**Uncertainty**

Same as for mwr.z03.

**Constraints**

Same as for mwr.z03.

Tags: a2e, atmosphere-to-electrons, b0, eere, microwave-radiometer, mwr, reviewed-data, und-radiometrics-mwr-rufus, weto, wfip2, wind, wind-forecast-improvement-project-2, z02
Organization: Department of Energy
Lidar - ND Halo Scanning Doppler, Boardman - Raw Data

**Overview**

The University of Notre Dame (ND) scanning lidar dataset used for the WFIP2 Campaign is provided. The raw dataset contains the radial velocity and backscatter measurements along with the beam location and other lidar parameters in the header.

**Data Details**

  1) A Halo photonics scanning lidar, owned by ND, was deployed and operated from 12/17/2015 to 02/09/2016. On 02/09/2016, this lidar was replaced by a Halo photonics scanning lidar owned by the Army Research Lab (ARL).  
  2) For information on the scanning patterns, refer to attached "ReadMe" file.  
  3) Data Period from 12/15/2015 to 02/09/2016: One data file per day (24 hours). File name of each daily data file has {boardman} as {optionalfields}. For example: lidar.z07.00.20150414.143000.boardman.csm.  
  4) Data Period after 02/09/2016: One scan file every 15 minutes, one stare file, and one background file every hour. File names have the following {optionalfields}: {background_boardman} for background files; {scan_boardman} for scan files; and {stare_boardman} for stare files. For example:  
  - lidar.z07.00.20150414.143000.background_boardman  
  - lidar.z07.00.20150414.143000.scan_boardman
  - lidar.z07.00.20150414.143000.stare_boardman
  5) Site information:  
  - Site: Boardman, OR  
  - Latitude: 45.816185° N  
  - Longitude: 119.811766° W  
  - Elevation (meters): 112.0

**Data Quality**

Raw data: no quality control (QC) is applied.

**Uncertainty**

The lidar measurements' uncertainty varies with the range of the measurements. Please refer to Pearson et al. (2009) for more details.

**Constraints**

  1)  Because of the change of lidars, the data were downloaded in different formats. Hence, the raw data (unfiltered) primarily are in two formats: *.csm and *.hpl.  
  2) The data were downloaded every one hour or 15 minutes. Hence, the datasets are not concatenated for continuous scans.  
  3) A lidar offset of +195 deg (to True North) was added to the azimuthal angles from the ND scanning lidars, spanning 12/17/2015 until 02/09/2016. Later, this was corrected for the data from 02/09/2016 as the lidar aligned to True North.  

Tags: 00, a2e, atmosphere-to-electrons, eere, lidar, nd-halo-scanning-doppler-boardman, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z07
Organization: Department of Energy
Lidar - LLNL ZephIR Profiler, Arlington Airport - Reviewed Data

**Overview**

These are 10-min averaged data from a vertical-profiling ZephIR 300 lidar. 

Data collected at the Arlington airport for the WFIP2 project.

March 10, 2016 - April 1, 2017

**Data Details**

1 Hz data are available from:
wharton4@llnl.gov

**Data Quality**

Instrument applies proprietary filters and checks on data.

Other than the Quality Assurance (QA) procedures implemented by the lidar during data processing, no other quality procedures are applied.

**Uncertainty**

Freezing weather (i.e., ice buildup in the modem box) caused instrument failure during a number of days this month.

Tags: a2e, atmosphere-to-electrons, b0, eere, lidar, llnl-zephir-profiler-arlington-airport, reviewed-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z06
Organization: Department of Energy
Lidar - LLNL WindCube V2, Vansycle Ridge BPA Tower - Reviewed Data

**Overview**

Data submission for WFIP2 at Vansycle Ridge (Oregon).

Vertical-profiling lidar data from a Wind Cube v2, included 10-minute averages of wind speed and wind direction up to 200 m. Data collected during WFIP2.

**Data Details**

Z-wind has the following notation: 
negative = upward
positive = downward

probe volume is +/- 20 m at all heights

**Data Quality**

Other than the Quality Assurance (QA) procedures implemented by the lidar during data processing, no other quality procedures are applied. These data include a carrier-to-noise ratio (CNR) threshold of -23.

CNR below this threshold result in -9999 for all data points

Tags: a2e, atmosphere-to-electrons, b0, eere, lidar, llnl-windcube-v2-vansycle-ridge-bpa-tower, reviewed-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z08
Organization: Department of Energy
Lidar - HilFlowS - LLNL ZephIR300 - MOP - Processed Data

**Overview**

The ZephIR300 is a continuous wave LIDAR with a range of 10 m to 300 m. During HilFlowS the ZephIR300 was programmed to measure from 10 m to 150 m.  In addition, the ZephIR300 provided a measurement at 1 m height using an onboard meteorological sensor. The ZephIR300 has a 30° scanning cone angle, data sampling rate of approximately 15 s, wind speed accuracy of 0.5 percent, and direction accuracy of 0.5°.

**Data Details**

Data begins:  2019-07-12\
Data Ends:  2019-09-23

Additional Information, files begin with:	\
Time and Date	\
Timestamp (s)\
Battery (V)\
GPS\
Met Compass Bearing (deg)\
Met Air Temp. (C)\
Met Pressure (mbar)\
Met Humidity (%)\
Met Wind Speed (m/s)\
Met Wind Direction (deg)\
Proportion Of Packets With Rain (%)

Available at each level (150 m - 10 m):\
Packets in Average\
Wind Direction (deg)\
Horizontal Wind Speed (m/s)\
Horizontal Wind Speed Min (m/s)\
Horizontal Wind Speed Max (m/s)\
Horizontal Wind Speed Std. Dev. (m/s)\
Vertical Wind Speed (m/s)\
TI (turbulence intensity)

Tags: a0, a2e, atmosphere-to-electrons, eere, hilflows, lidar, llnl-zephir300, mop, processed-data, weto, wfip2, wfip2-hill-flow-study-hilflows, wind, z02
Organization: Department of Energy
Lidar - HilFlowS - LLNL WindCube v2 - EOP - Processed Data

**Overview**

The WindCube v2 is a pulsed LIDAR and uses four beams sent in succession in the four cardinal directions along a 28°scanning cone angle to measure horizontal velocity and wind direction. A fifth beam is sent in the vertical direction to measure vertical velocity. Measurement heights are user-programmed and range from 40 m to 200 m. During HilFlowS, the WindCube v2 was programmed to measure from 40 m to 150 m at 10-m intervals. The data sampling rate was 1 s, wind speed accuracy was 0.1 m/s, and direction accuracy was 1.5° for the instrument. The data were averaged across 10-min. averaging intervals.

**Data Details**

Data Begins:  2019-07-03\
Data Ends:  2019-09-23

Additional Information, files begin with:\
Timestamp (end of interval)\
Wiper count

Available at each level (40 m - 150 m):\
Wind Speed (m/s)\
Wind Speed Dispersion or Standard Devation (m/s) \
Wind Speed min (m/s)\
Wind Speed max (m/s)\
Wind Direction (deg)\
Z-wind or Vertical Wind Speed (m/s)\
Z-wind Dispersion or Standard Deviation (m/s)\
carrier-to-noise ratio (CNR), specified in decibels (dB)\
CNR min (dB)\
Dopp Spect Broad (m/s)\
Data Availability (%)

Tags: a0, a2e, atmosphere-to-electrons, eere, eop, hilflows, lidar, llnl-windcube-v2, processed-data, weto, wfip2, wfip2-hill-flow-study-hilflows, wind, z01
Organization: Department of Energy
Shortwave, Longwave Radiometer - ESRL RadSys, Condon - Derived Data

**Overview**

This dataset showcases the role of shortwave and longwave radiation in planetary boundary layer (PBL) development and winds. Radiation budget is part of the energy budget. 

**Data Details**

Wasco Airport, OR: 45.58991, -120.67196, 1488 ft


**Data Quality**

Refer to documents "QCRad Output ReadMe" and "QCRad Flag Key."

**Uncertainty**

Refer to featured references.

**Constraints**

N/A

Tags: a2e, atmosphere-to-electrons, c0, derived-data, eere, esrl-radsys-condon, shortwave-longwave-radiometer, swlwr, weto, wfip2, wind, wind-forecast-improvement-project-2, z03
Organization: Department of Energy
Lidar - ESRL WindCube 200s, Wasco Airport - Processed Data

**Overview**

The available "Readme" file introduces the basics of the Doppler lidar data and offers a detailed description of the variables present in the data files. 

For those with any further questions about the data and its interpretation, contact either Alan Brewer (<alan.brewer@noaa.gov>) or Sunil Baidar (<sunil.baidar@noaa.gov>). It is highly recommended to discuss any planned use of the data with National Oceanic and Atmospheric Administration-Chemical Sciences Division (NOAA-CSD) scientists.

For more information, refer to the Readme file: "noaa-esrl-wascolidar-readme.docx."

**Data Quality**

Refer to the attached "noaa-esrl-wascolidar-readme.docx" Readme file.

**Uncertainty**

Refer to the attached "noaa-esrl-wascolidar-readme.docx" Readme file.

**Constraints**

Refer to the attached "noaa-esrl-wascolidar-readme.docx" Readme file.

Tags: a0, a2e, atmosphere-to-electrons, eere, esrl-windcube-200s-wasco-airport, lidar, processed-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z04
Organization: Department of Energy
Lidar - ESRL WindCube 200s, Arlington Airport - Processed Data

**Overview**

The available "readme" file introduces the basics of the Doppler lidar data and offers a detailed description of the variables present in the data files. If you have any further questions about the data and its interpretation, contact either Alan Brewer (<alan.brewer@noaa.gov>) or Sunil Baidar (<sunil.baidar@noaa.gov>). It is highly recommended to discuss any planned use of the data with NOAA-CSD scientists.

For more information, refer to the attached readme.

**Data Quality**

Refer to attached readme file.

**Uncertainty**

Refer to attached readme file.

**Constraints**

Refer to attached readme file.

Tags: a0, a2e, atmosphere-to-electrons, eere, esrl-windcube-200s-arlington-airport, lidar, processed-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z05
Organization: Department of Energy
Lidar - CU WindCube V2 Profiler, Gordons Ridge - Raw Data

**Overview**

Wind and lidar turbulence profiles from 40 m to 220 m above the surface.

**Data Quality**

These two-minute-averaged data files consider the 1 Hz line-of-sight measurements that pass the -22 dB CNR quality control threshold.

**Uncertainty**

Line-of-sight measurements are converted to horizontal wind speed by assuming horizontal homogeneity in the measurement volume (as discussed in several publications, including Rhodes and Lundquist 2013 and Lundquist et al. 2015). In inhomogeneous flow, this assumption may not be valid. These instruments were sited to avoid breaking the horizontal inhomogeneity assumption, although the Gordon's Ridge sight may be problematic in this respect.

Tags: 00, a2e, atmosphere-to-electrons, cu-windcube-v2-profiler-gordons-ridge, eere, lidar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z02
Organization: Department of Energy
Lidar - CU WindCube V1 Profiler, Wasco Airport - Raw Data

**Overview**

Wind and lidar turbulence profiles from 40 m to 220 m above the surface.

**Data Quality**

These two-minute-averaged data files consider the 1 Hz line-of-sight measurements that pass the -22 dB CNR quality control threshold.

**Uncertainty**

Line-of-sight measurements are converted to horizontal wind speed by assuming horizontal homogeneity in the measurement volume (as discussed in several publications, including Rhodes and Lundquist 2013 and Lundquist et al. 2015). In inhomogeneous flow, this assumption may not be valid. These instruments were sited to avoid breaking the horizontal inhomogeneity assumption, although the Gordon's Ridge sight may be problematic in this respect.

Tags: 00, a2e, atmosphere-to-electrons, cu-windcube-v1-profiler-wasco-airport, eere, lidar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z03
Organization: Department of Energy
Lidar - CU WindCube V1 Profiler, Troutdale - Raw Data

**Overview**

Wind and lidar turbulence profiles from 40 m to 220 m above the surface.

**Data Quality**

These two-minute-averaged data files consider the 1 Hz line-of-sight measurements that pass the -22 dB CNR quality control threshold.

**Uncertainty**

Line-of-sight measurements are converted to horizontal wind speed by assuming horizontal homogeneity in the measurement volume (as discussed in several publications, including Rhodes and Lundquist 2013 and Lundquist et al. 2015). In inhomogeneous flow, this assumption may not be valid. These instruments were sited to avoid breaking the horizontal inhomogeneity assumption, although the Gordon's Ridge sight may be problematic in this respect.

Tags: 00, a2e, atmosphere-to-electrons, cu-windcube-v1-profiler-troutdale, eere, lidar, raw-data, weto, wfip2, wind, wind-forecast-improvement-project-2, z01
Organization: Department of Energy