Monitor creates config dir if it does not exist