Package: rlmate
RLMateProject under development.The RLMate is a package designed to take over parts of Reinforcement Learning that are needed frequently.
It comes together with the command line tool 'Hermes'.The idea is to have a toolto organize RL tasks and carry out several scripts,to execute common RL tasks, e.g., plot training curves,have commonly shared code as a python package instead of reimplementing it over and over again.InstallationSimply install the current version withpip install  rlmateFurther instructions will be added when the package involves.InstallationtodoCommand Line ToolAll available commands can also be seen by using the help functionhermes -hAvailable commands:exec -f file: execute the specified Hermesfile.exec -e command: execute the specified command.Not supported yet!exec -n name: give the execution file a name to make the results directory more human readable.create: create an example Hermes fileshelp command: show a detailed help of the specified command.-ho: show help for hermes options used in .hermes files (also see below)SettingsSettings in this context means something that is not set for a particular execution/hermesfile, but for thegit repositorythat is currently used.
The settings are saved in the root if the repository in the.hermes_settingsfile.
The current settings (with the default value if there is no settings file) are:path_to_experiment ('./'): specifies the path where to store the results of the experiment in. Takes the repository root as entry point.threads (1): specifies how many of the specified jobs should be executed parallel.The syntax is as follow:setting:valueand only one setting should be specified per line.Hermes-optionsFor each job, different Hermes options can be specified. Currently, these options are:-ca file: thefileis copied to the experiment folder after the execution of the job.-cb file: thefileis copied to the experiment folder before the execution of the job.-ma file: thefileis moved to the experiment folder after the execution of the job.-l/--log (True | False): ifTruethe stdout and stderr of the job will not be printed to console, but stored in log files. Defaults toTrue.-m: if set, a telegram message will be sent to the chat_ids specified in the.hermes_settingsfile.HermesfileThe Hermesfile specifies the experiments that should be ran.
Hermesfiles have the ending.hermes.
Each file is divided into 3 parts:1. PREIn the PRE part of the Hermesfile, the settings can be adjustetfor the given Hermesfile only.
So if you generally want to process the files by using two threads, and thereforce specified so in the.hermes_settingsfile, you can change this for the current hermesfile only by specifying it in the PRE section.
This is done linewise per setting.
The syntax is the same as for the settings file.2. STD-HSometimes, some Hermes options should be applied to all jobs of the Hermes file.
Hermes-options specified in the STD-H section will be applied to all jobs.
The syntax is one Hermes-option per line with-flag file3. STD-EAlso, there sometimes are script arguments that should be applied to all jobs while just a few are about to be varied.
Such arguments specified in the STD-E section will be applied to all jobs.
The syntax in one argument per line, e.g.-ne 100or-n.This standard arguments will be addedbeforethe arguments specified in the exec lines.
Note that this order may be important for your script.4. EXECIn this section the jobs are specified with the following syntax:[[cmd],[Hermes-options]]whereby the Hermes-options are separated by comma.
In each line, one job can be specified.
All settings that should be saved automatically must be set in the cmd.StorageAll files will be saved in the directoryexperiments/script_name/uniqe_name, wherescript_nameis the name of the script specified in the jobunique_nameis the unique combination of date and time, commit number, and name that may have been specified with the-nflagand the experiments directory will be created on the first call in the directory as specified in the settings.If during the execution of the script new files or directories will be created, they are automatically moved to the storage if they include theunique_name.
How this name is given to the script will be specified in the next section.Additionally, in the future there will be an overview file giving detailed information about all the made experiments.Script CompatibilityFor your script to be compatible with Hermes, there are basically two things you need to consider:All the parameters that should be saved must be specified by command line.
If you want to save additional parameters, make sure to specify it by archiving the files by using the Hermes-options.This is the only strong requirement: The first argument of the executed script must be the unique name, that is determined by Hermes.
You must not do anything with that identifier except for saving additional files as specified in the Storage section.