Package: arm-test-data
arm-test-dataA place to share atmospheric data with the community, shared throughout the Atmospheric Radiation Measurement user facility and beyond!Sample data setsThese files are used as sample data in openradar examples/notebooks and are downloaded byarm-test-datapackage:201509021500.biAAFNAV_COR_20181104_R0.ictNEON.D18.BARR.DP1.00002.001.000.010.001.SAAT_1min.2022-10.expanded.20221107T205629Z.csvNEON.D18.BARR.DP1.00002.001.sensor_positions.20221107T205629Z.csvNEON.D18.BARR.DP1.00002.001.variables.20221201T110553Z.csvanltwr_mar19met.dataayp22199.21mayp22200.00mbrw21001.datbrw_12_2020_hour.datbrw_CCl4_Day.datco2_brw_surface-insitu_1_ccgg_MonthlyData.txtctd21125.15wctd22187.00t.txtenametC1.b1.20221109.000000.cdfgucmetM1.b1.20230301.000000.cdflist_of_files.txtmaraosmetM1.a1.20180201.000000.ncmarirtsstM1.b1.20190320.000000.ncmarnavM1.a1.20180201.000000.ncmet_brw_insitu_1_obop_hour_2020.txtmet_lcl.ncmosaossp2M1.00.20191216.000601.raw.20191216000000.inimosaossp2M1.00.20191216.130601.raw.20191216x193.sp2bmosaossp2auxM1.00.20191217.010801.raw.20191216000000.hknsacloudphaseC1.c1.20180601.000000.ncnsasurfspecalb1mlawerC1.c1.20160609.080000.ncsgp30ebbrE13.b1.20190601.000000.ncsgp30ebbrE32.b1.20191125.000000.ncsgp30ebbrE32.b1.20191130.000000.ncsgp30ecorE14.b1.20190601.000000.cdfsgpaerich1C1.b1.20190501.000342.ncsgpaosccn2colaE13.b1.20170903.000000.ncsgpbrsC1.b1.20190705.000000.cdfsgpceilC1.b1.20190101.000000.ncsgpco2flx4mC1.b1.20201007.001500.ncsgpdlppiC1.b1.20191015.120023.cdfsgpdlppiC1.b1.20191015.121506.cdfsgpirt25m20sC1.a0.20190601.000000.cdfsgpmetE13.b1.20190101.000000.cdfsgpmetE13.b1.20190102.000000.cdfsgpmetE13.b1.20190103.000000.cdfsgpmetE13.b1.20190104.000000.cdfsgpmetE13.b1.20190105.000000.cdfsgpmetE13.b1.20190106.000000.cdfsgpmetE13.b1.20190107.000000.cdfsgpmetE13.b1.20190508.000000.cdfsgpmetE13.b1.20210401.000000.csvsgpmetE13.b1.yamlsgpmetE15.b1.20190508.000000.cdfsgpmetE31.b1.20190508.000000.cdfsgpmetE32.b1.20190508.000000.cdfsgpmetE33.b1.20190508.000000.cdfsgpmetE34.b1.20190508.000000.cdfsgpmetE35.b1.20190508.000000.cdfsgpmetE36.b1.20190508.000000.cdfsgpmetE37.b1.20190508.000000.cdfsgpmetE38.b1.20190508.000000.cdfsgpmetE39.b1.20190508.000000.cdfsgpmetE40.b1.20190508.000000.cdfsgpmetE9.b1.20190508.000000.cdfsgpmet_no_time.ncsgpmet_test_time.ncsgpmfrsr7nchE11.b1.20210329.070000.ncsgpmmcrC1.b1.1.cdfsgpmmcrC1.b1.2.cdfsgpmplpolfsC1.b1.20190502.000000.cdfsgprlC1.a0.20160131.000000.ncsgpsebsE14.b1.20190601.000000.cdfsgpsirsE13.b1.20190101.000000.cdfsgpsondewnpnC1.b1.20190101.053200.cdfsgpstampE13.b1.20200101.000000.ncsgpstampE31.b1.20200101.000000.ncsgpstampE32.b1.20200101.000000.ncsgpstampE33.b1.20200101.000000.ncsgpstampE34.b1.20200101.000000.ncsgpstampE9.b1.20200101.000000.ncsodar.20230404.mndtwpsondewnpnC3.b1.20060119.050300.custom.cdftwpsondewnpnC3.b1.20060119.112000.custom.cdftwpsondewnpnC3.b1.20060119.163300.custom.cdftwpsondewnpnC3.b1.20060119.231600.custom.cdftwpsondewnpnC3.b1.20060120.043800.custom.cdftwpsondewnpnC3.b1.20060120.111900.custom.cdftwpsondewnpnC3.b1.20060120.170800.custom.cdftwpsondewnpnC3.b1.20060120.231500.custom.cdftwpsondewnpnC3.b1.20060121.051500.custom.cdftwpsondewnpnC3.b1.20060121.111600.custom.cdftwpsondewnpnC3.b1.20060121.171600.custom.cdftwpsondewnpnC3.b1.20060121.231600.custom.cdftwpsondewnpnC3.b1.20060122.052600.custom.cdftwpsondewnpnC3.b1.20060122.111500.custom.cdftwpsondewnpnC3.b1.20060122.171800.custom.cdftwpsondewnpnC3.b1.20060122.232600.custom.cdftwpsondewnpnC3.b1.20060123.052500.custom.cdftwpsondewnpnC3.b1.20060123.111700.custom.cdftwpsondewnpnC3.b1.20060123.171600.custom.cdftwpsondewnpnC3.b1.20060123.231500.custom.cdftwpsondewnpnC3.b1.20060124.051500.custom.cdftwpsondewnpnC3.b1.20060124.111800.custom.cdftwpsondewnpnC3.b1.20060124.171700.custom.cdftwpsondewnpnC3.b1.20060124.231500.custom.cdftwpvisstgridirtemp.c1.20050705.002500.ncvdis.b1Adding new datasetsTo add a new dataset file, please follow these steps:Add the dataset file to thedata/directoryFrom the command line, runpython make_registry.pyscript to update the registry file residing inarm-test-data/registry.txtCommit and push your changes to GitHubUsing datasets in notebooks and/or scriptsEnsure thearm-test-datapackage is installed in your environmentpython-mpipinstallarm-test-data# orpython-mpipinstallgit+https://github.com/ARM-DOE/arm-test-data# orcondainstall-cconda-forgearm-test-dataImportDATASETSand inspect the registry to find out which datasets are availableIn[1]:fromarm_test_dataimportDATASETSIn[2]:DATASETS.registry_filesOut[2]:['sample_file.nc`]To fetch a data file of interest, use the.fetchmethod and provide the filename of the data file. This willdownload and cache the file if it doesn't exist already.retrieve and return the local pathIn[4]:filepath=DATASETS.fetch('sample_data.nc')In[5]:filepathOut[5]:'/Users/mgrover/Library/Caches/arm-test-data/sample_sgp_data.nc'Once you have access to the local filepath, you can then use it to load your dataset into pandas or xarray or your package of choice:In[6]:radar=pyart.io.read(filepath)Changing the default data cache locationThe default cache location (where the data are saved on your local system) is dependent on the operating system. You can use thelocate()method to identify it:fromarm_test_dataimportlocatelocate()The location can be overwritten by theACT_TEST_DATA_DIRenvironment
variable to the desired destination.