Package: cloudnet-submit
Cloudnet data submission toolInstallationLinux/macOSIf you havepythonandpipinstalled (python >= 3.8),
run the command:pipinstallcloudnet-submitAfter that, you can usecloudnet-submitcommand to run the program.WindowsIf you are using Windows Subsystem for Linux,
then the aforementioned Linux installation should work.If you are using windows command prompt
and havepythonandpipinstalled,
you can installcloudnet-submitwithpip:pipinstallcloudnet-submitTest if thecloudnet-submitcommand works:cloudnet-submit--versionIf not, you can use an alternative way to run the program:python-mcloudnet_submit--versionGetting startedConfiguration fileGenerate a configuration file:cloudnet-submit--generate-configThis will generate a file namedcloudnet-config.tomlin your working directory.Update your submission credentials in theuser_accountsection,
and updatesite,instrument,instrument_pidandpath_fmtfields
to match your instrument/model setup. Remove unnecessary instrument and model sections.Possible values forsiteare listed inhttps://cloudnet.fmi.fi/api/sites.
You can only upload to sites your user account has permissions for.Possible values forinstrumentare listed inhttps://docs.cloudnet.fmi.fi/api/upload-file-types.html.You can find values forinstrument_pidfrom thelist of instruments.
If your instrument does not have PID yet,
pleasefill the formfirst.# cloudnet-config.toml[user_account]username="alice"password="alicesSecretPassword"[[instrument]]site="hyytiala"instrument="rpg-fmcw-94"instrument_pid="https://hdl.handle.net/21.12132/3.191564170f8a4686"path_fmt="/data/hyytiala/rpg-fmcw-94/%Y/%m/%y%m%d_*_P10_ZEN.LV1"[[instrument]]# you can have additional sections for the same instrument# e.g. for different pathsite="hyytiala"instrument="rpg-fmcw-94"instrument_pid="https://hdl.handle.net/21.12132/3.191564170f8a4686"path_fmt="/home/alice/hyytiala/rpg-fmcw-94/%y%m%d_*_P09_ZEN.LV0"[[instrument]]site="granada"instrument="chm15k"instrument_pid="https://hdl.handle.net/21.12132/3.77a75f3b32294855"path_fmt="/data/granada/chm/%Y-%m/%Y%m%d_Granada_CHM170119_*.nc"[[instrument]]site="kenttarova"instrument="halo-doppler-lidar"instrument_pid="https://hdl.handle.net/21.12132/3.a93d1483f10742ff"path_fmt="/data/kenttarova/halo/system_parameters_*_%Y%m.txt"periodicity="monthly"[[model]]site="hyytiala"model="ecmwf"path_fmt="/data/hyytiala/ecmwf/%Y/%Y%m%d_hyytiala_ecmwf.nc"# You can use proxies (optional)[network.proxies]http="http://10.10.1.10:3128"https="http://10.10.1.10:1080"# Alternatively, You can define proxies as environment variables# HTTP_PROXY and HTTPS_PROXY# see: https://requests.readthedocs.io/en/latest/user/advanced/#proxiescloudnet-submitwill look for files specified in thepath_fmtfield
for a given measurement date.Use the following format codes:DirectiveMeaningExample%YYear with century0001, ..., 2023, ..., 9999%yYear without century (zero-padded)00, ..., 23, ..., 99%mMonth (zero-padded)01, 02, ..., 12%dDay (zero-padded)01, 02, ..., 31You can also use wildcard character*inpath_fmtfield.Allowed values forperiodicityare valuedaily(default) ormonthly.
This specifies whether a file contains data from a single day or entire month.
If a monthly file changes, e.g. it's appended each day of the month, the file will be resubmitted and replaces the previously submitted data.
For example, HALO Photonics Doppler lidars produce monthlysystem_parameters.txtfiles.By default,cloudnet-submitexpects thecloudnet-config.tomlfile to be
in your working directory.
You can also use--configto specify another location for the config file:cloudnet-submit--config/path/to/your/config.tomlUsageBy default,cloudnet-submitsubmits data from the past three days.Use--dry-runto list files that would be submitted:cloudnet-submit--dry-runSubmit data to the Cloudnet data portal:cloudnet-submitYou can also set the number of days to be submitted (including today):cloudnet-submit--last-ndays5You can also specify a date you want to submit:cloudnet-submit--date2022-06-21Or a list of dates:cloudnet-submit--date2022-06-212022-05-01Or a range of dates:cloudnet-submit--from-date2022-05-01--to-date2022-06-24See all the options:cloudnet-submit--helpFeedback and contactBugs, feature requests, documentation:Create an issueon GithubOr justsend us mail:)