Quentin Gallouédec commited on
Commit
8ece5c4
1 Parent(s): 8df9d61

Initial commit

Browse files
.gitattributes CHANGED
@@ -32,3 +32,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
32
  *.zip filter=lfs diff=lfs merge=lfs -text
33
  *.zst filter=lfs diff=lfs merge=lfs -text
34
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
32
  *.zip filter=lfs diff=lfs merge=lfs -text
33
  *.zst filter=lfs diff=lfs merge=lfs -text
34
  *tfevents* filter=lfs diff=lfs merge=lfs -text
35
+ *.mp4 filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,77 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: stable-baselines3
3
+ tags:
4
+ - ReacherBulletEnv-v0
5
+ - deep-reinforcement-learning
6
+ - reinforcement-learning
7
+ - stable-baselines3
8
+ model-index:
9
+ - name: ARS
10
+ results:
11
+ - task:
12
+ type: reinforcement-learning
13
+ name: reinforcement-learning
14
+ dataset:
15
+ name: ReacherBulletEnv-v0
16
+ type: ReacherBulletEnv-v0
17
+ metrics:
18
+ - type: mean_reward
19
+ value: -4.18 +/- 11.26
20
+ name: mean_reward
21
+ verified: false
22
+ ---
23
+
24
+ # **ARS** Agent playing **ReacherBulletEnv-v0**
25
+ This is a trained model of a **ARS** agent playing **ReacherBulletEnv-v0**
26
+ using the [stable-baselines3 library](https://github.com/DLR-RM/stable-baselines3)
27
+ and the [RL Zoo](https://github.com/DLR-RM/rl-baselines3-zoo).
28
+
29
+ The RL Zoo is a training framework for Stable Baselines3
30
+ reinforcement learning agents,
31
+ with hyperparameter optimization and pre-trained agents included.
32
+
33
+ ## Usage (with SB3 RL Zoo)
34
+
35
+ RL Zoo: https://github.com/DLR-RM/rl-baselines3-zoo<br/>
36
+ SB3: https://github.com/DLR-RM/stable-baselines3<br/>
37
+ SB3 Contrib: https://github.com/Stable-Baselines-Team/stable-baselines3-contrib
38
+
39
+ Install the RL Zoo (with SB3 and SB3-Contrib):
40
+ ```bash
41
+ pip install rl_zoo3
42
+ ```
43
+
44
+ ```
45
+ # Download model and save it into the logs/ folder
46
+ python -m rl_zoo3.load_from_hub --algo ars --env ReacherBulletEnv-v0 -orga qgallouedec -f logs/
47
+ python -m rl_zoo3.enjoy --algo ars --env ReacherBulletEnv-v0 -f logs/
48
+ ```
49
+
50
+ If you installed the RL Zoo3 via pip (`pip install rl_zoo3`), from anywhere you can do:
51
+ ```
52
+ python -m rl_zoo3.load_from_hub --algo ars --env ReacherBulletEnv-v0 -orga qgallouedec -f logs/
53
+ python -m rl_zoo3.enjoy --algo ars --env ReacherBulletEnv-v0 -f logs/
54
+ ```
55
+
56
+ ## Training (with the RL Zoo)
57
+ ```
58
+ python -m rl_zoo3.train --algo ars --env ReacherBulletEnv-v0 -f logs/
59
+ # Upload the model and generate video (when possible)
60
+ python -m rl_zoo3.push_to_hub --algo ars --env ReacherBulletEnv-v0 -f logs/ -orga qgallouedec
61
+ ```
62
+
63
+ ## Hyperparameters
64
+ ```python
65
+ OrderedDict([('alive_bonus_offset', 0),
66
+ ('delta_std', 0.03),
67
+ ('learning_rate', 0.02),
68
+ ('n_delta', 8),
69
+ ('n_envs', 1),
70
+ ('n_timesteps', 1000000.0),
71
+ ('n_top', 8),
72
+ ('normalize', 'dict(norm_obs=True, norm_reward=False)'),
73
+ ('policy', 'MlpPolicy'),
74
+ ('policy_kwargs', 'dict(net_arch=[64, 64])'),
75
+ ('zero_policy', False),
76
+ ('normalize_kwargs', {'norm_obs': True, 'norm_reward': False})])
77
+ ```
args.yml ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ !!python/object/apply:collections.OrderedDict
2
+ - - - algo
3
+ - ars
4
+ - - device
5
+ - auto
6
+ - - env
7
+ - ReacherBulletEnv-v0
8
+ - - env_kwargs
9
+ - null
10
+ - - eval_episodes
11
+ - 5
12
+ - - eval_freq
13
+ - 25000
14
+ - - gym_packages
15
+ - []
16
+ - - hyperparams
17
+ - null
18
+ - - log_folder
19
+ - logs
20
+ - - log_interval
21
+ - -1
22
+ - - max_total_trials
23
+ - null
24
+ - - n_eval_envs
25
+ - 1
26
+ - - n_evaluations
27
+ - null
28
+ - - n_jobs
29
+ - 1
30
+ - - n_startup_trials
31
+ - 10
32
+ - - n_timesteps
33
+ - -1
34
+ - - n_trials
35
+ - 500
36
+ - - no_optim_plots
37
+ - false
38
+ - - num_threads
39
+ - -1
40
+ - - optimization_log_path
41
+ - null
42
+ - - optimize_hyperparameters
43
+ - false
44
+ - - progress
45
+ - false
46
+ - - pruner
47
+ - median
48
+ - - sampler
49
+ - tpe
50
+ - - save_freq
51
+ - -1
52
+ - - save_replay_buffer
53
+ - false
54
+ - - seed
55
+ - 2337213954
56
+ - - storage
57
+ - null
58
+ - - study_name
59
+ - null
60
+ - - tensorboard_log
61
+ - runs/ReacherBulletEnv-v0__ars__2337213954__1671645640
62
+ - - track
63
+ - true
64
+ - - trained_agent
65
+ - ''
66
+ - - truncate_last_trajectory
67
+ - true
68
+ - - uuid
69
+ - false
70
+ - - vec_env
71
+ - dummy
72
+ - - verbose
73
+ - 1
74
+ - - wandb_entity
75
+ - openrlbenchmark
76
+ - - wandb_project_name
77
+ - sb3
78
+ - - yaml_file
79
+ - null
ars-ReacherBulletEnv-v0.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5eb655a4cb0d2a9593e216ccc2a47bc3799614c6a9dd4781dfbe20695b6214b6
3
+ size 63015
ars-ReacherBulletEnv-v0/_stable_baselines3_version ADDED
@@ -0,0 +1 @@
 
 
1
+ 1.8.0a6
ars-ReacherBulletEnv-v0/data ADDED
@@ -0,0 +1,164 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "policy_class": {
3
+ ":type:": "<class 'abc.ABCMeta'>",
4
+ ":serialized:": "gAWVKgAAAAAAAACMGHNiM19jb250cmliLmFycy5wb2xpY2llc5SMCUFSU1BvbGljeZSTlC4=",
5
+ "__module__": "sb3_contrib.ars.policies",
6
+ "__doc__": "\n Policy network for ARS.\n\n :param observation_space: The observation space of the environment\n :param action_space: The action space of the environment\n :param net_arch: Network architecture, defaults to a 2 layers MLP with 64 hidden nodes.\n :param activation_fn: Activation function\n :param with_bias: If set to False, the layers will not learn an additive bias\n :param squash_output: For continuous actions, whether the output is squashed\n or not using a ``tanh()`` function. If not squashed with tanh the output will instead be clipped.\n ",
7
+ "__init__": "<function ARSPolicy.__init__ at 0x7f9b9d395280>",
8
+ "_get_constructor_parameters": "<function ARSPolicy._get_constructor_parameters at 0x7f9b9d395310>",
9
+ "forward": "<function ARSPolicy.forward at 0x7f9b9d3953a0>",
10
+ "_predict": "<function ARSPolicy._predict at 0x7f9b9d395430>",
11
+ "__abstractmethods__": "frozenset()",
12
+ "_abc_impl": "<_abc._abc_data object at 0x7f9b9d393e40>"
13
+ },
14
+ "verbose": 1,
15
+ "policy_kwargs": {
16
+ "net_arch": [
17
+ 64,
18
+ 64
19
+ ]
20
+ },
21
+ "observation_space": {
22
+ ":type:": "<class 'gym.spaces.box.Box'>",
23
+ ":serialized:": "gAWVrwEAAAAAAACMDmd5bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lIwFZHR5cGWUk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMBl9zaGFwZZRLCYWUjANsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWJAAAAAAAAAAAAID/AACA/wAAgP8AAID/AACA/wAAgP8AAID/AACA/wAAgP+UaAtLCYWUjAFDlHSUUpSMBGhpZ2iUaBMoliQAAAAAAAAAAACAfwAAgH8AAIB/AACAfwAAgH8AAIB/AACAfwAAgH8AAIB/lGgLSwmFlGgWdJRSlIwNYm91bmRlZF9iZWxvd5RoEyiWCQAAAAAAAAAAAAAAAAAAAACUaAiMAmIxlImIh5RSlChLA4wBfJROTk5K/////0r/////SwB0lGJLCYWUaBZ0lFKUjA1ib3VuZGVkX2Fib3ZllGgTKJYJAAAAAAAAAAAAAAAAAAAAAJRoIksJhZRoFnSUUpSMCl9ucF9yYW5kb22UTnViLg==",
24
+ "dtype": "float32",
25
+ "_shape": [
26
+ 9
27
+ ],
28
+ "low": "[-inf -inf -inf -inf -inf -inf -inf -inf -inf]",
29
+ "high": "[inf inf inf inf inf inf inf inf inf]",
30
+ "bounded_below": "[False False False False False False False False False]",
31
+ "bounded_above": "[False False False False False False False False False]",
32
+ "_np_random": null
33
+ },
34
+ "action_space": {
35
+ ":type:": "<class 'gym.spaces.box.Box'>",
36
+ ":serialized:": "gAWVFAwAAAAAAACMDmd5bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lIwFZHR5cGWUk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMBl9zaGFwZZRLAoWUjANsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWCAAAAAAAAAAAAIC/AACAv5RoC0sChZSMAUOUdJRSlIwEaGlnaJRoEyiWCAAAAAAAAAAAAIA/AACAP5RoC0sChZRoFnSUUpSMDWJvdW5kZWRfYmVsb3eUaBMolgIAAAAAAAAAAQGUaAiMAmIxlImIh5RSlChLA4wBfJROTk5K/////0r/////SwB0lGJLAoWUaBZ0lFKUjA1ib3VuZGVkX2Fib3ZllGgTKJYCAAAAAAAAAAEBlGgiSwKFlGgWdJRSlIwKX25wX3JhbmRvbZSMFG51bXB5LnJhbmRvbS5fcGlja2xllIwSX19yYW5kb21zdGF0ZV9jdG9ylJOUjAdNVDE5OTM3lGgujBRfX2JpdF9nZW5lcmF0b3JfY3RvcpSTlIaUUpR9lCiMDWJpdF9nZW5lcmF0b3KUjAdNVDE5OTM3lIwFc3RhdGWUfZQojANrZXmUaBMolsAJAAAAAAAAAAAAgFPCs5yHA7WTcuyrW+jmsvLPtoHa1QbvYaExTaBrtczZE+YYn3SceS/IpRuAxHkBSZ4PQ+Rd4BiTkhNVzNRKKWTSCJW+NNCeRHJ6A/Ctvwpzm3s+6WCxBtp1A0ULbn3WFmrrBDRmg7fz9aUvae9CY0O1XPfCd1LMRkQ3LQiJbtCOrnf7GLaAT3ue+U8y7BLYuY5ehakZyq49di1nK0KAnsXuxx/1IgFdS88kD8wZUmREV5hwnQr1Ehe16VreO8T/Qc86sV+2h90z2FiJqqLNf3s/yZS3bA9DHzGZfRtgkKu3Bx0ZTN7I+466APXPqRreJf4gBqUW/NB248FO9cpD0wFaed9QV63NqpiFOs/RYeEwD8e32dZFRfi9SK5aLvuApJMu2LOfZweypHIkyPjeY5W+tsm2bdPmVoCAOiyi73cf5k0LQeJNWqZU/wuy/f8myghZ9qrjf+2JSJMaB9VNMXWmxuq4Dq0fkhzJr1ML7SgftfSG29O5koFUMozQL58gAzyX96ZMcpWbZ+3/zlaVhGln5egXC8MtIK6xIFCvh/vD/F1jLgYIp14MM597MuPmTpa+OaKek7bql9Cp8/0skhg5QSCvCaijm8wenxrfqLyRxDPCpS+L3isJC5LrjFgWnsdxQXVrJK8uaobJcTIJ5NrYYfA2l5gH27iPI9EqhzFtZJXiE4vXpH18f3kouYV9RowPzOtmYsbmstR/Mx/VY7E0XBmnMidL4dYTUXgxaDbFxWy3y6miL2yw0I2O09vPWV7LqbwMbthlU26lrLfnJDz88B+7y4pFCwvsHgCsMWq6pvroAF4Ms+++JnhzrL0GLrtfJ7667p42Vg78GirmKIRMFH0p6aLRPV4V/fclE3PLBj0InU315M5v7fDFj/IreJeFUhIAy5/BlvLdgwIfBMBWvyjhqGRBo2KmdiDAO9BPhdi6oGmZUCxTDjUyMd8rjeRdntTE+L9sHQUSvUfpRjKcSIjZXcjsMMSwwU0QzIXewD4nZg8EAZ72iHnChWveW7cB5EQRFE+YPvvyNAw4OvORF+DjDtmLUz6jNz0JbkuKbhIQEEVbpDRkoeIGA4HATymZeE4TX/hvhOxJfX5liXD9/Uon8OjJ/hhIrDNUYR2NOV2R1L+VuK/JA9o0izGPiCC9vi7UK1u4re8tvPrBInC6BH2DpMvWSRepdH0frFxGsH/kRB/S77USeMs38a+yorDaa9Wsb9WnuQg10vl087jhvwSZx77fGq52NV1h/UnZAjnqJOjCPBgQrY0wsSeSW6SOSdItAOupiWkVvSzHz+gopd/3FUUPbjdik7Vd6O6ycGOFwp4+wyZqq1MKHww5exJND6De8NB4fGBzsvKoT8O1fAC3Y2Z+3mLYwkCJXULx2zNSO90bQi0L0BhTF1AidNtqRkak72V+V1kos6m4F+kyZiOiwxfcHKWHmpQe3A8HpX6nacx0Zso0WyF/W/sOLo//2g0YD9koIjgKvw//f9Em4CvxNBUMnJYTVQJGysF4QMShnM6byaMNJhRVALf+X0+SgLJkEwLfKdBbKxjA035OEc2YKmUpvooVUUt+9U8d7cKRgNYKKPwCHyYfLJSQt4ZEdThgjeywDxgsGzPax5SklOLroSYn39feofatZDzJXevfPTHyi1ZLwpe6Hwkbqz1FuOnHiShPedbEA9b/HCtBytSZrgUwlwHpQlAiBTSxpN7TFzVZrrhRd6N8W+FeE9SAGCHwXchFR4SCGThPyRGO/XWkMPJ42BLUOmMGepDQgWH646tjoJSE3EXcA5iDS+Nq6Oh521oC2UPAnvxIj1QbVh8IbxlBytRTTjc0c14E9cyhIPlgIoHriuEFSMXSEzOGL1MmL6UCbiXfsRg9Z6OwWCCl3VeGg5bEZ1kjJkvs08k7wtPk4ATAjaTL3QoY2gf106zFbJtL4D5gmLMJ9OuzE2Fn5uaAqqpjXIqqEXxS9jtpsRU9VTHCg68RwXQVIUhuVJgHq8fOigBMrW7Am5+jjo/GNNlcFcp813dFiXy4qHhjGSEjNXp3ln03NZkOgqXQ8SalJlPOvyrAS9wW9EtjQKhcrBSWSsQ8C3o/Mc/sR/CMRB85ZIojR/tiCKtOutxQMIusIOnYHK8g6kPpTQ8J/PfJ8pa3GEoYoA67axQTXsysd2Y6ZDwpz1HkAeISVK2AlCcuQssrQv8dVLAcins/2kjRFp5Vp82HSX9j6Ci9GH5mkdyqV84vWsdwRz4JNXHZoHVZKnrxSdA1HUwRUI/5oWiqnGk9KyiS4Mv9dQIVluJ1+/pAHYEdG9YgLHiNE2zA7aIQbqqlGX6jH1CrHSPL9mnlHdPiKjozwRXu02UQuzlGJn+/PUkU6cPYLLeLc8e7S2qfCZxbdpHioand7wYKqb5bMb8dA3Dwvm6P6iJXSogJ+Q+0z43li8ydYJqZNZlSjsljr/2c5UU33vMhLDLEXIHT8WzrsS45TsKNbhYfTYx6Ds/8W5yOtiOPWc0+fRlAjbQC++FKo5UaMl2eRCxI4U5/heX2HxJGNk50rICjuFsG/8Q+NUuJgS+y3FMhe+sm1e2MdC+ldkBqEn8oRxajECbP4Wizz1tfJliW/1A5fdGTfUxM3HV72bJgnqswmoAumAx6d36KfuZwEEp0/wcrdo+8/unJ5f2mYeqCrOcaxDJrs6SxW1zVaH/YTZl+RNA0NjPLgaqnlveaes/MkpzsVEQDtvKGFrG1cnmGjZVi2azrSDGQ0Y423nEksDC5awYcOJmVYbeA4DkMSNfj+7Dx2SzH/PVPuXLX9aw9K9QF4Ml48zsSrwsVjIa8+gIdffs2pf2wCKcPtFez6vOT0UDuFHknJjMDg0fI3DnyC7jJqO8V4XpmPyarTp3JJRGhmqTHhpZInn70JMfS+RFry5+rLSOM0T+KWV8fYjs9eyCiZijlR4AiADooXm9G8JIzZCLZX2Dty83iyz7gQzSxYO7ULuTT1stvGuJwbBP4LMhLXkbxdhAmBSDiYNOnc3O+yFsO6Ps9UOQD8S4Pbr8hZ4mFjbicpO635SwpmHINYDeuewln3/GHz69LpCjmpnKPeF9ZxXcq6MR4kJUV2j/dQzqjLniNaQmrMkULdI7W1sMXRFcsz9xs1GVwVqmtMVws8HtvXMYNmosCrrgAFX2ghPz7dXCV6vML5YhfNbDAzzG6MHffrslrhMav3vtlt8Fnld4VaH6IhMkowayT1lSVvfvlKHCWwtKaTcOZrR5LZGalJOpFbVIFUOAo+LnY/25bmc3KloyLzgiTudjPsXEGPNPBIvE/5cMEvU4Lrs0N3tCke4abYDXF9f14QrwLlGgIjAJ1NJSJiIeUUpQoSwNoDE5OTkr/////Sv////9LAHSUYk1wAoWUaBZ0lFKUjANwb3OUTXACdYwJaGFzX2dhdXNzlEsAjAVnYXVzc5RHAAAAAAAAAAB1YnViLg==",
37
+ "dtype": "float32",
38
+ "_shape": [
39
+ 2
40
+ ],
41
+ "low": "[-1. -1.]",
42
+ "high": "[1. 1.]",
43
+ "bounded_below": "[ True True]",
44
+ "bounded_above": "[ True True]",
45
+ "_np_random": "RandomState(MT19937)"
46
+ },
47
+ "n_envs": 1,
48
+ "num_timesteps": 1000800,
49
+ "_total_timesteps": 1000000,
50
+ "_num_timesteps_at_start": 0,
51
+ "seed": 0,
52
+ "action_noise": null,
53
+ "start_time": 1671645642260144664,
54
+ "learning_rate": {
55
+ ":type:": "<class 'function'>",
56
+ ":serialized:": "gAWV/QIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMZS9ob21lL3FnYWxsb3VlZGVjL3JsLWJhc2VsaW5lczMtem9vL2Vudi9saWIvcHl0aG9uMy45L3NpdGUtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lIwEZnVuY5RLgEMCAAGUjAN2YWyUhZQpdJRSlH2UKIwLX19wYWNrYWdlX1+UjBhzdGFibGVfYmFzZWxpbmVzMy5jb21tb26UjAhfX25hbWVfX5SMHnN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi51dGlsc5SMCF9fZmlsZV9flIxlL2hvbWUvcWdhbGxvdWVkZWMvcmwtYmFzZWxpbmVzMy16b28vZW52L2xpYi9weXRob24zLjkvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMHGNsb3VkcGlja2xlLmNsb3VkcGlja2xlX2Zhc3SUjBJfZnVuY3Rpb25fc2V0c3RhdGWUk5RoH32UfZQoaBZoDYwMX19xdWFsbmFtZV9flIwZY29uc3RhbnRfZm4uPGxvY2Fscz4uZnVuY5SMD19fYW5ub3RhdGlvbnNfX5R9lIwOX19rd2RlZmF1bHRzX1+UTowMX19kZWZhdWx0c19flE6MCl9fbW9kdWxlX1+UaBeMB19fZG9jX1+UTowLX19jbG9zdXJlX1+UaACMCl9tYWtlX2NlbGyUk5RHP5R64UeuFHuFlFKUhZSMF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMC4="
57
+ },
58
+ "tensorboard_log": "runs/ReacherBulletEnv-v0__ars__2337213954__1671645640/ReacherBulletEnv-v0",
59
+ "lr_schedule": {
60
+ ":type:": "<class 'function'>",
61
+ ":serialized:": "gAWV/QIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMZS9ob21lL3FnYWxsb3VlZGVjL3JsLWJhc2VsaW5lczMtem9vL2Vudi9saWIvcHl0aG9uMy45L3NpdGUtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lIwEZnVuY5RLgEMCAAGUjAN2YWyUhZQpdJRSlH2UKIwLX19wYWNrYWdlX1+UjBhzdGFibGVfYmFzZWxpbmVzMy5jb21tb26UjAhfX25hbWVfX5SMHnN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi51dGlsc5SMCF9fZmlsZV9flIxlL2hvbWUvcWdhbGxvdWVkZWMvcmwtYmFzZWxpbmVzMy16b28vZW52L2xpYi9weXRob24zLjkvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMHGNsb3VkcGlja2xlLmNsb3VkcGlja2xlX2Zhc3SUjBJfZnVuY3Rpb25fc2V0c3RhdGWUk5RoH32UfZQoaBZoDYwMX19xdWFsbmFtZV9flIwZY29uc3RhbnRfZm4uPGxvY2Fscz4uZnVuY5SMD19fYW5ub3RhdGlvbnNfX5R9lIwOX19rd2RlZmF1bHRzX1+UTowMX19kZWZhdWx0c19flE6MCl9fbW9kdWxlX1+UaBeMB19fZG9jX1+UTowLX19jbG9zdXJlX1+UaACMCl9tYWtlX2NlbGyUk5RHP5R64UeuFHuFlFKUhZSMF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMC4="
62
+ },
63
+ "_last_obs": null,
64
+ "_last_episode_starts": {
65
+ ":type:": "<class 'numpy.ndarray'>",
66
+ ":serialized:": "gAWVdAAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYBAAAAAAAAAAGUjAVudW1weZSMBWR0eXBllJOUjAJiMZSJiIeUUpQoSwOMAXyUTk5OSv////9K/////0sAdJRiSwGFlIwBQ5R0lFKULg=="
67
+ },
68
+ "_last_original_obs": {
69
+ ":type:": "<class 'numpy.ndarray'>",
70
+ ":serialized:": "gAWVmQAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYkAAAAAAAAALlCCbrecYe+mBSGPbVgYD6E8ew96Ud+vwAAAADUg0o/AAAAAJSMBW51bXB5lIwFZHR5cGWUk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGJLAUsJhpSMAUOUdJRSlC4="
71
+ },
72
+ "_episode_num": 0,
73
+ "use_sde": false,
74
+ "sde_sample_freq": -1,
75
+ "_current_progress_remaining": 0.0016000000000000458,
76
+ "ep_info_buffer": [
77
+ {
78
+ "r": -8.915454,
79
+ "l": 150
80
+ },
81
+ {
82
+ "r": -14.181871,
83
+ "l": 150
84
+ },
85
+ {
86
+ "r": 7.589023,
87
+ "l": 150
88
+ },
89
+ {
90
+ "r": -15.550472,
91
+ "l": 150
92
+ },
93
+ {
94
+ "r": -5.621402,
95
+ "l": 150
96
+ },
97
+ {
98
+ "r": -17.373619,
99
+ "l": 150
100
+ },
101
+ {
102
+ "r": -4.880903,
103
+ "l": 150
104
+ },
105
+ {
106
+ "r": -6.509102,
107
+ "l": 150
108
+ },
109
+ {
110
+ "r": 3.407247,
111
+ "l": 150
112
+ },
113
+ {
114
+ "r": -3.739447,
115
+ "l": 150
116
+ },
117
+ {
118
+ "r": 2.710037,
119
+ "l": 150
120
+ },
121
+ {
122
+ "r": 11.867852,
123
+ "l": 150
124
+ },
125
+ {
126
+ "r": -9.561126,
127
+ "l": 150
128
+ },
129
+ {
130
+ "r": -20.792396,
131
+ "l": 150
132
+ },
133
+ {
134
+ "r": -2.389562,
135
+ "l": 150
136
+ },
137
+ {
138
+ "r": -0.664386,
139
+ "l": 150
140
+ }
141
+ ],
142
+ "ep_success_buffer": {
143
+ ":type:": "<class 'collections.deque'>",
144
+ ":serialized:": "gAWVIAAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKULg=="
145
+ },
146
+ "_n_updates": 417,
147
+ "n_delta": 8,
148
+ "pop_size": 16,
149
+ "delta_std_schedule": {
150
+ ":type:": "<class 'function'>",
151
+ ":serialized:": "gAWV/QIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMZS9ob21lL3FnYWxsb3VlZGVjL3JsLWJhc2VsaW5lczMtem9vL2Vudi9saWIvcHl0aG9uMy45L3NpdGUtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lIwEZnVuY5RLgEMCAAGUjAN2YWyUhZQpdJRSlH2UKIwLX19wYWNrYWdlX1+UjBhzdGFibGVfYmFzZWxpbmVzMy5jb21tb26UjAhfX25hbWVfX5SMHnN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi51dGlsc5SMCF9fZmlsZV9flIxlL2hvbWUvcWdhbGxvdWVkZWMvcmwtYmFzZWxpbmVzMy16b28vZW52L2xpYi9weXRob24zLjkvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMHGNsb3VkcGlja2xlLmNsb3VkcGlja2xlX2Zhc3SUjBJfZnVuY3Rpb25fc2V0c3RhdGWUk5RoH32UfZQoaBZoDYwMX19xdWFsbmFtZV9flIwZY29uc3RhbnRfZm4uPGxvY2Fscz4uZnVuY5SMD19fYW5ub3RhdGlvbnNfX5R9lIwOX19rd2RlZmF1bHRzX1+UTowMX19kZWZhdWx0c19flE6MCl9fbW9kdWxlX1+UaBeMB19fZG9jX1+UTowLX19jbG9zdXJlX1+UaACMCl9tYWtlX2NlbGyUk5RHP564UeuFHriFlFKUhZSMF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMC4="
152
+ },
153
+ "n_eval_episodes": 1,
154
+ "n_top": 8,
155
+ "alive_bonus_offset": 0,
156
+ "zero_policy": false,
157
+ "weights": {
158
+ ":type:": "<class 'torch.Tensor'>",
159
+ ":serialized:": "gAWVj04AAAAAAACMDHRvcmNoLl91dGlsc5SMEl9yZWJ1aWxkX3RlbnNvcl92MpSTlCiMDXRvcmNoLnN0b3JhZ2WUjBBfbG9hZF9mcm9tX2J5dGVzlJOUQgdOAACAAooKbPycRvkgaqhQGS6AAk3pAy6AAn1xAChYEAAAAHByb3RvY29sX3ZlcnNpb25xAU3pA1gNAAAAbGl0dGxlX2VuZGlhbnECiFgKAAAAdHlwZV9zaXplc3EDfXEEKFgFAAAAc2hvcnRxBUsCWAMAAABpbnRxBksEWAQAAABsb25ncQdLBHV1LoACKFgHAAAAc3RvcmFnZXEAY3RvcmNoCkZsb2F0U3RvcmFnZQpxAVgOAAAAOTQyODQ3NTEzMDMyODBxAlgGAAAAY3VkYTowcQNNQhNOdHEEUS6AAl1xAFgOAAAAOTQyODQ3NTEzMDMyODBxAWEuQhMAAAAAAABWjSO7KBs3PmR3jL5WM3u+TncDvuYPtz2radi731GHPpZU8rxmpLQ9kE/OvUswhr3QC6O+GA9ivpu0DL6rTko86/AGPsvOTD5mZ2e+U6MUvsv09z00uI0+MH6MvXtsfz6rEVy9tngQPdyImj6KUp6+3uFWvtbTrL0+DQW+xnSTPs4+Xb6AIB2+I3huvvrWn74GQEe+arSSPihPGD5WbyU+K5yPPPj+Lr5W/mY9v1mfvs6idr6z9y++M1xXPoghSD4wYRe+1g5FvKtNWj5Xqqk+GHgHPmByOD3+22Q+VvpIvvZrfj2eUYS+y5JsvsNTML6zcRo+UEUJPo4wSr4LPc496GE7PitULL2rhVA8Vi2ePVbBUz6G36M+D4WDvjst+r27JQY+4GeNPvCDlD7ClpY+UNyHPaZolL5rM/s8O4pVvrMNn77Uopc+oMSBPqo+qr5gjX89CwFmvUuuYL1oPxy+CEMDPkYsSr57Qvo9c50sPtBZdD62Qf89MuqovgBsXb7Qbio+EOKOPWQihb7gi0S+942gPhv/ZT521BS+G9GrvaaTor5WU8S7poWAvhelg75rdZa8gP9MPU7JC74giko+9rZPvpvbmj5r6mk+mOuPvrDnqb0AbnY8IDRHPTbpoT3o8gU+QJGjPN6LJr7jgyE+OrajvoBPSr5Q5Kq9nkQmvtDR7r3S4Yu+qzaRvabskT3zXV6+1iKMvABYdD5LWwy9VsgXPFaS67y2KIo9gAhZPtKpoT4IxFg+gwiiPoB8xbxEUJm+gNEhvmhqaD6rnA27k6gpvqzIgr4AuJ++SAuQvkt4ir1zMDs+8Ik4PqyYpL7o6lQ+XIyFvqBSkL2+Zgq+9n2DvWAJhr3SJZm+LlyTvoulVb0AQY07Jg8bvnuUAD4nnJm+AEm4vGwWlj4mOgu+zxyaPvY69z0fBZq+8PVXPkuNHb2gXxi+Y3mIPjjqib7LgRI91u2OvR7Acz4LkL49MwMkPgAX8T0AKqS9i5GPvaukjL4Q8zg+b4GHPnuMaT7mxHC+K5NzPBaecL4L5ju+luVGvkZM6T2wZ0u+Vk3uu4C/ZTwGCFw+pwKBvltUar77Mka+HuluPhBl9b2W9I8+gNv2PQDjLD0AniK7W/OGvatNKz0g4pu9q34ZuwA1Lj0Qf4W+TucyvubPiT4EgYq+KxTEvIDUqD7AmvY9gKAaPMTmk77IFik+CyBzvuDIwb27C+W9SzBKvVbzbjtkxIw+VnIqPWvdmD5AzFA+s8tXvuMWGT6GSXG+aKoQvqvJyD1AaeE99wmAPuDC272r4gs6+LkvPucMpb4Dx3Y+yyCNvquKljsrIWi9Y8UzviB1ND2iII0+i47HvcilSr4Gevy97yepvmgTGj4W7iO+FsljvoOkRL5uQEQ+28I0Pov9gj52nvc9sPvjvRvFvr0grsk9P0uMPpucuT0TgCG+/nMgvixcob4gfZM94Iw/vospmL5Sp5U+a6pdvotSG71glMM9K/0tPE6tZb4e9Im+EAmIPkBUXj3alo0+i9vkvUsVyT0QHJy9K99yvBjjT77m4OY9ANbXPatR4buAiJm9dmhSvhsMbD7GGH6+HtULPpCM5b2zriS+gEZ1PdhOMb4rSp09CxCGPbhvfb52U2M9Q2IRPj4cBz7L3Su9EumLvsB4Ur1rGO095hb5vU6QAT6zUGM+TjoyvlZvVzsYJA0+FgbWPMAY5Dygeyo9UiuGviuZ1jzwXGw+Q8qZPnaeSD529TY9U2gfPj4NJr7zbY2+h8KSvjxCqj6+rFg+7vBrvk6LBT7H4YA+15mqPuY6lT6DOYQ+9oGcvYCT770sIIw+uEY/PkBoTb6qbpk+C+skPqsSOj6O8FW+YNvDPTtR773+WYU+y611vabiBD5Wg3I9+zkRPiv9572jbCY+U2luvgYvmj2A8Wa+fF6ovgsOib56vIY+a6w4PkYfoD6GuYg+wGmYvr7vaL42nVy9Q6xdvksFbT58BoG+e4kmvi7hpL5eykG+l16MPiy8iz7bVnQ+wsaDPifBlz5Azq69+C8WPlgNmD7G1uE9h5yqPnYJMT52MFQ+kO3uvfjHIz7A4hw9WwijvbhpQL4ehz++IlODvr4lZT4eqnI+a2QbvVuGRb7C6IM+ZkdaPkD7yjzQJyG+0NmcPsiVCz6Sj4G+l1ejPoyZgT5m0/i90OE/Ph7xQb6g91W9zOmQPlaoYTyrZXG+cCvkvXtOub3AtIO9y6kCPWzWnT5rM5I8u8BSvlb1izw7qiM+qFApPpb6m77rUHS99qh9vlukEb7W9fU9IGRyvvvD/T2v25A+lhmzPJZ+Y77WlvS95hGVPS8agr7zkyk+bvGavowPpL6A1KW+8HyKvRaGZT5MiKG+H9uNPoiKCL428cc9gA15PLbkmb7wiY0+6Mk3PlakqT4eciw+tk1hvoZvjj4WwpI8q90hPnPYiL5gWsS945KnvmDyBL7ARZM9PgCGvhac2T3mOjc+IDQ+PWZhZL48UoS+MJ3SvcDUFT5SWKg+zkZEPsu/Gb2rWu89S2+nvkLEkb7TRB8+HlZBvsg2JD5L9XC+7hApvoaTjL4jHzI+6x4LvWNYgz7gPVM+0N88PoCdLzzGENO98G6UvSB0NT3DMyk+eyJvvpw8jz7rcxS9ZwKPvluuOL5HApc+ThScPscVnr7ovXA+9g8rPqAKSj5ueZA+M/Y3vtCR1z1Yrws+NrnJveB05D2QacS9gAhTPrZovb3Gfv69VtyrPTYj8j0LxCa+62LxPJvQRT6g2Ae9NsLPPXumpL1ARu89iEJ3vr62SL7wQS2+M9icPtuxt71WlW663l8lvvZfqj5fr6Y+67aAvrZair44XYG+VrXSurADrr0Ta1++gNr0vRD6gD3wVzK+W0SXPduLnL3LZSW+tpM7PQNVjD62xGa+AJh9PNa++73ueac+Guyhvoyco74gLKg+S/VXvhbigj1WrOu8+86Pvdt4mL2m5Vg+gISCPN8ppr52gkm+prjovbjDKz5o41y+yuygPsYMmL12KXW9LLqFPoiOKz7yvpA+PnFFPvAWz70bd2K+gCvLvApAjT7QHeW9akWevhjsCz6eI6Y+AFjCvedQjb4Lzpq+axOrPevDzrx2Xiy+G/2JPdafAT4EvIc+qICEPkBeTL3/fJa+5jeavoZZnz5g4xY+K8oUPhaqk74/Cp4+Dq6hPpIWmj7L+I++BssAvrjBar6PnaE+A6oSvljWG7421DI+8OUdvj4dKL4A2+68NjwDvRfyhL6ER44+zpEWvusm8j1ucZQ+2CMsPsBNQT2DNpE+YIk3PY7rHb5ac6E+65KhPSaEpr52WcK9U4FovuyhlT6remG9IpGbvquoq7ybXFY+a1uxPbvc1z0Wm/08y4L+PUZVpr1QyAe+CoafvsuRgL5L7xM+vpSXveDokjwQbSM9oAERPED6pb3w0fQ9Jt2UvWaP0j1upsu9WFL2vIpBiz18MVG9Dg3XPQYrsL1E+9a94N5mvbCHpTyotus95G10vQwbNz2sXAC9KBHevNg8vD16Zca9YIZZPKi+8D3ItYy8psTGPYSsHb0AEs499qL3vSiVk7yo3LO8eO4lPSTfSD2mj8Q9yI+YvGBtorvKT689kIgKvRBr4D2qcqq9IJ1dvAAA3LugdWQ9ZgWvPdBOorxOF9S9KLF9PcwnGT2Iq009Cuudva7CpD3AePI9MLUxPMwd772ctbM9wM+9vZhj6zwwzpQ8fKJvvbBGMj2K+eS9yDnpPJxKor0wdV28SLeDPAgZ2j0cSXS9ugCkPSgVgry8KXO9uuzevXzi6r0oA/o9mGL/vCCXzDs8zwo97gKuPUh92j3Sns89hKq9veAPpLwefJe9HESSvWjm8jw8S/A9JhXNva7umj08uoS96HLHvJI0yz0wmee8cHs6PMzzsr3s6tk9UF+EvGg8u7086xU9PAW2vUwjy71ghvk7zPfKPUjjEL1A+3A9evzbPXjLqT2iSYa9YIBgvGAeIb0A2829AKBYOJafwD0ar9c9cBQ/PPCS6Dzop129Wj3BPSwMVb3E1LG9eLCdPFJxmT20zua9amrnPawuOD1cW7O9yJPcvLgZ3j1+acS9XKUVvQjtJz0cR+C9uFaMPZxChT3KxZ49Sjajvez5/j04v5e9PpP/PUau9b2cFuS9+DudPeAKVjygS+w7HMONvXzFVr3QsxW9QGL5vSDd1DuAGrU8APDduCBXJT3m5/I99CEIPdhtO71AtlK9TMqjvcp2sb1A6qS8QBy1vATFYz0A2Vq9ihXMPVChs70ARLo5nh/mPQaQ/j2ISpS9cGe2PFDqcTxUDXC9tOQwvWCtCj10A7K9oPSoPBiOXT2Qw0m95qTUPaDHBrwITWg9uIT9PZCAHL3MHIs9bHISvSiUlbzYia28AJNLutxqQb0gA/A8wFaaO5pGoj1YQ8+8sF9NPIR1Pr1eY9a9jDBPPWgHgzw0DE29GBwtvSDmBT0QKLm8MkqnPaAC6Du0ZkE9lBNfPVBB+7xAhl09Mum8PcB9vDu4Y8g8oNSUO/4+sT38KVi99hSIvRgbXz3ozN69gFYDO9h2a73296g9lFjuvZw4mz18Rv09QDLPPJBzCLxa/vs97M1avRAdJLwUNWC9sFqNvBiO3jxQxIg8cGjBvI71/71gu9E7wKlyuxgMmjz6KMQ9nNX4PVzhl71gZ/+7GCVNvfjw673eR7q9ikXwPX5DlT28gok9MEWOPfpiy71QFFc8UEPuPbjejr10vOM9xJIGPW4btD2gVVu9hApsPdzw4r3wCQK8OMcqPcSLGT0OOdY9ao/7Pdbl6D1c4Ks94PuzPWAghLwCq8a9fBE+vfDqZbzGVoq9GNyCPdi5Mz1wOaU8sFv3PEDi4D2IfDo9Gn/gvVLTub3wqWE9yIyLPLiyeT0crP+9KkHsvWj8nD3Sv6M9JJvnvQBZQj1o5ce97N7BPSSpID0kIf09+Gn8vfJx9r0GFa09YEjjPZjYnD1KMqo9GJ/XvdpLuT2gs/G9aMPkPFywp700XUu9iFG1POROSb0wBaK8nqTyvSRg8b10VEY99LdYvWy/m72wBkq9LEzRvX6lzL3uLpk9KByCPYBmiDys14u9yFcqPYADuDvM9La9uFrcPGgZ6T2gzfu9fJD+vTAzgzwSxsA9/MWbvaBr4TzY9rM9pNsdPcia3Tz4av896samPTj7j72gBTE8iMiCPdLE4T3ss/69GKCKPWCmFL0+rvq9KE3jPLJei70AHZE8DDWmvb6lwL1gxi28dP4rvbK5lT0gkzA8sNLHPZDmvzywoyS9vGWtPYDT3ztAMsA8uKskvQAy6zlA48S8kB0uvCymx70AhUm6yH3UvUBL3LwkXZQ9egKyvaiOrL1oCfq8TFsMvbBZrTwAAKo8FNGBPXpasL2ghxC8ti2PPcZu3T1wZBW8dCCUvUwuEz1EyZE9nO+fvRyOlL2YTWI9wH4PvKrK8b0Um5O9AKJPPXCoLb3asrA90mDKPRD2lDzw8SG80IUivSAez7uwY7o8vovDvUi79Lzo8NS9Ch+dPbQHo70C3uk92PsDvfSnkr30/XU9MKiYPMxEsT2YvlU9ap32veTqoT1Y1cC8CEpiveSSoj1ktbo9mgHhveAvObyYOtI9dEpGPRKs1z00di+9cDiNvQoj3D3QaVU9asH1PVTcVb1+XqS9UA1wvGIL8b34sEg9mNK8PXjR9TxAW0q8VNp9PRB/or0kbvo9To3+veY79b0Q+fG8uBzRPcAOTTykoUQ9Vqa7vRi4Oj3A2WS8wDhNPVDMtD1ojl49IDYuvGBP/LvijqC9BDE5vcpbpj1sT029dvyePTwGS70Ife68AFguOyDs6r0AmKO6AG5OvCD8N7yws8y8GNPJPbrsvD2Aga29dNZtPUzNyL0y8Nm9WIIcPYDJ8Drs2W69uOn2vbQ2Rr38ASs9OPTsvfax+L3g6oE8aGy4vcxG4L08REW9aN2kvOig6L008Kq9cEgGPJhm8b2A7Y+8xkylvQB4sb1cO0k9YgrFvWwBwr34/ZE9GHS/PHok6T302gi9wE13vQCJPbwAySU6qDzDPRj//r2w0RG8/HtiPZD5jL2EFYK94G53PaBL9b2IpPI8FjHGveR+fj3u49q92GOdPYRW8r1iL9e9AHPxOpy5yT2+PNu98GFkvSDX4D3guKu8HB1UPYRF9r2kAyG9SgGCvdzS1z0cgFQ9Bsy6vbAYpTwAT7y6iF1SvRQykr3A5im9NsnJPaKDt70iXLa9OPYdvcCCDjtcXws9gNN1O8iA9rzEOZu9ML23vHgbTr1s1M49XjH5vbpKo71yR9C9mCS7vHZ+xz3gZOA9ttzevYB3sbtqQ5Y9NLBhPcqw0T1AO2O7KgGsvRBaqT2Aki+9oo2EPdhZ/LzwpVk9yEDmPQIL7j0G+ui9xlapveyxU71gQKO9zKH1PYDgNLyw0Km9qNVjvcRnjb3841A92kvfvfix7r3YWvy9qG1cPSgpfT0K/569GO79PKz5vD3gyZQ82KjYvKBPFzwwmlu8UuWAPbDTrb140YE9okmQPZoam71QCtE9dnD7PVjYSb2IaA+9dCh/PT6OyL14eUo9cOfuPEpdoT0EXd69UK7UvUD0ZT2MbTg9skbuvcbCjr0IPOq9fme3vaQDZ72Q2dM9ANTLvK4Ikz1KHvM9vFVpPYIs5b0004A9ZEtDPbJqxj30hvy9sHGdPe6L0T1iLO69UEZWPFKK2j3eMLq9QP8nPcA9Yj2sMAY93Ij+PYqb0T3sots90EZ/vN611j3Uke69JiWKvagD27zUFxi9QnfsPRx+cT3u0KQ9NCKuPaA7v72QM228eIeVPNgqBT3ApIM9cLpLvbhiGr2uNNY9rGkJvQTUsb0ElK09EFqtPdiLIL3Yt8y8tOW8vbTI1b2QiUA9/LhaverMyz2K+8y94IqNvEDhMDsKkoM9TDDPPUZdrT1gYWE9PAFrvWLStr1YBeW9QC7LOxJK+D1IgMK8gG+su54Iur1gMB09vEyiPfxk/L1aQbS9Bp+9PWhy8jygXv+7aAy3POCwm7xe77K9zDbvvYxfqD0QlXO8eCY+vawnBL3YoIu9WKUXvQzB271yk789RBJRPTYbgb2cwC690LNlPayYPb3cAgc9kPkMPXgmob28QQA9QJz6OxaW3z14QDm9fJ4DvdyR3D3aDNG9APcTPBao9j18kGW9Mmz1PcIo4z2+Ku49MG1DvAyW5z2cFl+9oEIvvbSnQT0wUdg8ZiCNPSBI8z3SQKC9tN2HPQxMKz20Doc9uMZyPRiGP73GVMq9BObMPfb6kb3yqqM9cuDzvYgnsbwAp606GC2xPECLJTycVSE9oAhkvDjI+jxmVf09NKWlveCg37s0cUO9Op/gPW4l2z3AY1+71HkxvXosnr2aLbc9YAgNvG4a8T2w/JE99hPgPfh5yj0QXKa9EN0VPSxOVL3mcoA9oCI4vJBLMTxGDbG9NMvkvSzOQD1w9u08IOUxPLLfrT1QzFW9DMA1Pbb+jL04LNQ8GMfpvJxIsz0W3t89klfePWBBuDsg9pY9iMf/vQorlr04A7c8AL82Oor6yL38nWK9uCFvvZai/b3AUUM8gIOuPVTNTz2gRHO9bhPrvfCIzr2A9Bc7FhuwPZBYT70WTYu9mpCIvfBKMbySHPO94ufhvQYB/D1YLnS9QLG4vKz8CL3I5eC9MIa0vFS7HD3I5k+9IJKuuwC/HLpo2f69Fgq6PTLKzj3Oiq491CMovbTGhT0m2u+98FL9vPhD0LwI0DS9QApXPfxLab0AX228fNcTvb5n8L2gGqm8NPTYvVBGlT2Q0og9mtHvPVjuK71gStA7kJfIPECL/z0up+o9eH2EvcLU2b3Uuua9AI92vco91z189Cs9ngD3PabAvT2Ah+06mqmevfL7+T0YW809tKpdPezXi73oq8k9kGY6PKBGqT0YsVU9KvCHPUSi4L168o29oIqZPQBW1bz+tt69ZM7oPQAoMbvWgs49ChjIvUhHMD242kC9HHVXvVCT1bzEgz29HkeMPSCPwryOGsI92KjpPEA5nryO3ZO9jGnqvaBcFb1oEO29mLe9vIDkBTsg+wO8yIB7vSiusT2OLJA9SEr8vFBLSr3W8aA96rnePUpn6r2gPt28EA8+vAxgOb2ujNo9qEGXvJoM2T0A/iE6MCZevEJTlb1IPiq9SPskPRB6Yj2AvJG7gu3zPZ4vsb3ETkQ9rpLmPTgOsrygPcs9QAoHO0y0v70gcoy9CJM+PUSRXb2ISPY8KPj7PZjqLT0ArD+8MPT/PCh+k73UGte9Ym/AvWzP1r0QJdI8QHXHPGiVWb0UaPq9Kq2KPbxBkb1Y9Kq8wKbWvaxskL38lVU9qIXuvTr7kb1S7r89DkqDvWQSVb2UwQ+97NtaPaDtp73wV008KBpRPcCrFLyIKLk8+knDvZR5Zz14WT89SHGAvMat072YyUw99gynPRAbs7wsU3E9CMc9PYzITL1ALA68DtX+PQCzGjoYzsu9cFsVvFy3fj0AISe9IBCGvSLj0j1QbYc9aPitvKBC0Tsgmli80LztPOCRkTsg6pq9iLi9PIBCVjsQaQQ89B1DvZwvAz1uA8+9dAwZPYa5ij2QY2G8YNzGvQA87rkAEDo5hjzdvUwRtb3IyOw9DHG/PUDgjT2iWLE93BlFPewSkD3qjak92DbvvEgsgrw2irY9ANA8uGSTpr2KgMa9rCyPPb4M1D0Q0MY9wGmqPDq2sD3ICuu9QnC4vbxU9r10Qc49gECUugjCa71EPy09kKg/vSIvpL1AekU9QH67PIpTt70Snqi9sA9wPQ6owj3AuCY8wJWAvVA7dz1Yl7I8ah/gvUbmpb1AIeA8AGiePbB8JL20kXc9SIuevZr59D1KabY9eM2/PPTIYz2cQTI9nBCXvQDejrq4hwg9oCHnvHJ99T0kckW9NqDkvUDAc734lu290vTSPXDXZb1gHbS94GJdvLZ+rL1EuoW96oKCPSQ0wL2MdHE9YK+6PQAAk7nEWGM9jmaPvRKixz1ksPg9CFfzPGBJ6T0eQP69QN9gvDB2yzwIg969zCd5PXAhQ710Ljm9NB3LvZBQUT3ERbq9cEzZvExyYz1M28A9YI3nPHT/Pr3Is169OrCPPZj9vTx4gNc94M9APaI6zj16Sc69Os7NPZQ9a730DQm9ACFEOlgIwLyYjco87B7kPcr0mL2QMx49kL/NvajIoDxO5dI91J2sPZQ62z06lIo98HApvHSuBT0M8VW9dEzZPTAugD0cX7u9IFrdPQAg87qAE7a7eCAMvRQWB72gAc07/PN5vQoi7r383YO98MXLvCZRwT3oU7w9DGKZvYBGnbuIxRO9svOIvVgRtLzMpjG9YhePPZjrfb2Yi5086HaQvTzMH72Ah8k9/Ft7vYBL9rsUfvQ9qD0vPcBNgr0EtJm9kIszvRhVIL0I6149IKnjvILo1z1mdoy9tBogvbxoOj2idMw9SOP0PTjmozygpqw76GRlvRKlkD3iY5S9uJMGvcb21b2WGva9eBePPaAiCzykE8w9BLXLPTpWhj1E5kw9dN8EvfD2hz1MNHY9QD4xPUB6bLtg9Jg8AGMROibJub3Ate08fDK8vVBseD36hpi9vD4nvVDRcr1MEMo9rEe0vZS3gj1KZIA91AK1PaBIAD3ejos9Nl7KPSC0yTzMFi491CzIvWxVCb0wsjk84CF4POTjNL1QyP29oCYFvbwDRD0eb9w97CznvUxydD1m6fK9MtD0vZBRoL3YQIe8nP8OPdywwr2OO8U9eIDnPQAD/DtAYdA9UMpnvWSLSr1gJIS8gMZfPASVsr0i/cy90EFKPZCfEz3Ub/o9wL9QvdDOND2YnE69oL98PQDm4rtcxr09wDmOPbwU1T2ojoM94OKZOx6d3D2oXpa9pnTxPe4o+j1ujPQ9eCpvvcqkh73QkgE8iG8fPaJqgD1cO1A9NvvZPcxGAL1A+Se9XJ8rPXitDj32VJW9kBdGPDJewr18NBa9PPJIvcRn4D3Icea9GCaXvX6H+r0QIQE9VgrFvSCnJT0I0rG9HP2jvb7Igr2wq5k8xjvrPWDM7z3QuRq8TsD6vewmKb38IEO96MzZvByhQz0C1IA9BAJjPRxDEj2cRU+9AM6tumhSgjwow4K94DQ3vFCmf7xA3/G9VoytPdAOT7w8Td29WorKPTi/ib1ARTU94OD9PUCdvTvkTRM9rG5LPYZ7wT3gFx29Wg6QvSBFILyANMg9QBcwPCjfsT0AoHO6iBcdPWBtjjtAYV47Vp3zvdDN370gQCo89Gd9Pfr3qz3guLE7sNFXPSwjVj0a/ty9yAHhvRR9xr3A1ww7ft+hvcDYI71wNJm8SMNHPXBs7TwqfO093ujmPSJRo70Ads65CBmpPNR83z34rR69lDdJvTAqor3uorw9tA0RvcTBP72OJq092I/rPWCcrLu6dLS9wpXQPUAbL7088Wu9YPmzvSA9dr2Cfci9UMSTvYw06b3YY868zNxNPQxWwr0ADDe5WM48vUyndz0iut09mL6HvEDYgL2Es8S91GeWvYTTEz0w8+o8Et2JPdgnmLyYioM9hhPkvaiiCT3uhfg94Fz9vYrlhL0i4qM94BmgvIh1iL0yLZw94EgJPKBtoDsMgxu9auHAPaIAjj3ocLc8MEacPDhghD2UfZ897AVSvcBhYLyQx2A9sBp4vW5f7z0cXK+9yEJsPVTjt73UYiQ9FM6yPbDidjxQRE28PMuiPYrRt73ktqy9GjDavaCUnb0AnlQ7DCpovcAh5DwgOIo70A7VPeQBXr3sEAy9HlGpPSR2Ab3SF/U9MFtLvQBws7pInfK8ON9uPYguRD3GU4i9ZrCoPXAiArwseQG9AD8lu4Apsj32Hvs9aCJ5PaAuszwKE6c9GBpWvVDJhb282xO9eLClveAkXD0AikI8PCwvvfDqT7wAbiK7koDbPciF5D3CFMW9eKU7PSS1RT2wxUM9gJqLvIwLAD2A1gA9HCr5PYZb9b2kSkK9wDysvSBbeL3gDMk8ViGcPT6Xwb1kgaY9XNbVPVBefL1AurI8tmyDvcBT2zz4X229vHNHveJeq716etW9qkrMPYBQgbyAQ2O7jM5+vcpusj0Qh5K9qBVPvVzWx73yQ9e9bkbjPZ6uxb0wX428IDQUvRCKOz208Qg9Tj/EvTTo5T2IAv+9MI9KPBAZK7xoTe28nHSuPSQl2D3IY4U8gNY0vbZSvj1I1qA9MOu3PLAJDL3gr6w72CvkPTAYXjxwy8m8Zr7YvZovib1i5Lg9IDyQu/BhCLxIWkc96G2ovRBZCryUABC9zvGFPcRW0D2OvqA9vNy+PabJ5L3AxDW9EIRyPFBv2b1A5Ao9ps2nvfxlWz22Mc89tv7avWSD1j1g5m49oPCovZgJ9T34t929IFisvTSxfr1Aas+7QOG3PMhBFr0epvK9YGdsvDY7wj2cGsU9zCaAPWislDwgcP48VFrFvTxUTz3Gx/69yHBTvViNBr0y/bs9QM1uu4Q4ab3Y5rI81GvUvUiOB72szA09wKIHvJAUV7z6dZw9/HbCvc5Cgb36zPc9wMPLPADMpby+moQ9cAGaPZAcq7zoRFW9cGGnvFjpOT0QuoK8/v2UPaTD0L0UNHu9sijDPWhWhjxgNM48+GQoPdj28by0wEy9fOISPSSyB72QgVO92EmHPMCv9zzQ6ji8sCGtvcDUmrwOFZG9sryGPSKgqb06Hsw9cOxLPZg3271U+r097Cr9vYAl7rve1Z+9ADvcvXDqSjxoP3i9xAu5PX4+yb1gfNQ9rHGaPVo44D0Y7hW9nuqcvdQTqr3O4dQ9CKh+vUAqfLz41Z28qCqwPHwR0r1AbM49nGy9vYzK+z1oVki9dJFkvVjAjLyQhxc9SLu9vBqA/730ELQ9pJD9PcwogT2ygPo9uIsLPRB7ILwe58u9yr7fvVZBsL385wG9EhKVPTQ+U73gFZ+7gDrnuoBXp71Awl27hi73PfKbzD16+cI9oPxJvABJETuo84s9CE4qvbR/T73eB9s9oNjpO1jarL36tNc98PWpPIj5iD2uVt69gAa+PCCVnD04upO89oKRvcDQzD1YJG49DNIRPUAs8jyAzzQ7uM6SPbja37xssZa9mIFDPXCZCD188UI9QHljvKjjh7zgxSK8bAEHPZ5xxL1ym+69nJY/PTQpjL2QSCy86PANPSigjzySCKU9wDqGPGCE/TyAUTe8CCeXPOy8Oz2cpa49JpDyvcRHVb34t+W9qCFMvWgNnD18j/K9cmHlvdo6lD1wLZe9Chq7PZyIHz08hQA9nl7LPa4h7b2yd7s9WAomPU6Mq73IJvk8tLEOvQiDTb0wzl283GNxvRbb3z36Vtw90HlavMwD470gk/q78E8HPKQdqz0AyYM7/AMVPQTaBz06QZG9HMuevR7O5L0AqYC63JQePWCfEbyUffg9QFfDvAIMp734qqo8VC8QvShhjLwaDfg9gAxru26g3z0owIg8pHk+vVSwuz0y05G9IIaHOygr5jyYzWU9ajPsvaDuyDsgkQS9VvulPWBCLD1ENU09KuyZPRBB5bzgNgO8fmDNPU5Vzr3G87C9UNIVPDzRSr0Aleo74iPiPWBpbbxCRtq9ZL5ovRYa6z1A9uC8LIBgvfx2Zj3giH08wLXhvYIx1T3yKJA96oLePQQNYD1wnyy9GCQnvWQgeD2ggca8QMLIPJwP+L3QF329YC4+PaDtybv0JHa97EzfvQ60oj1g4s28SIf7vRz89j0gJ3k9pB+ZvTrWur1GYPc9ANEIOtL2mb16UJM9WEzVvFBLDDzoW4W9ptTYvfIDqr1g4GC8olS5vdxQ/D2AU7E6iAJEvUxaSj0s9uK9JvGCvchOQD1+g9m9rC5/PSAlLDxkdNW9ChD+vWTRIT2UAXI9QLTMvJBe4r1wi5O9IKtZPEAElTtoDwM9WBC1PICy1rsWGYc90FL4PUgz1T38nug9PM0svdDALr3wgmK8fFMXPSg/Tz0AjTa8bFulveomwb26dPY9eKcJvbBpirxo5Jy9PNR9vTjp4DzApVc92GdKvfhzPL3yyso9ItiDvWr/vr2Qwp+8ZpjzPaDP3jxIfY08YAB/vLb4nz30xX29IJKtPfjp8TwAtGM8aPiMPLThnb0IIr49BnSGPdo4yL1eW+69wM0DvfwSqj3kEny9MEXtPeq1gL3UPue98DhhPUq2mr3wa6G84LEfvYC7IrxOEt+9tM3qvdAYXD3wEWi8UG2avUCwULvWqOm9EOgHPXwmcz3mRfg9ao7QvbBVeLwO7oo9LJ3qPQgjtr2olFk97GJTPb5Vmj2UfbC9kq+2PTQCX72alJ29kFLLPC7e2D1ah6m9Mq6IPXCMarwUcyM9srLHPbQECz0ihdS9oCYavZg9yzyK9de9YD2qPMx2ib1AjMu81Ck3PaoIzr0OW6S9gIZpPcQx/b0cLbA9cmXFvQDoA7voNdI8BAhKPRTknr14zYk88HVcPdqS2z0Up8C9VI1+vWgnFT0gfoO7eMGsvWx2171WT+O9siKzvVj+Wb0qxLG9RJPgvWDdHzwAIpY9vGZxvaDLTDwA+sm6bFNvPaqJsb3AdsI7+vLuPV7Dtj3Uuf29CCeavAC6mDp4Dym9PDCovawhsr2IGqo9GMIlvSDMA7yQPBY9WiGdvcCKNjyiRZg9IK6Vvbz1FD1A54u7DMKMPWAbqj0k1gc9AId3O2Zf3L3g2ks9EhOcPaz4Ob18Mf69EnTPPZBc8LzA38w8cO0PvThCoz3oq/k9gHigPdjwIr34ZrM9NNJ5PbDORzz8M869bNlbvXJI/b2uOKs9vA39PaIflT0MmCM9eAPyPMRv9j1gyYG9NOQrvVzb5b3gzEq80HsMPKgnDD1cGLK9QP5svLrx0r2WPdC90HiFPB7l+b2cVQg9rNPrvaQhsr3YedS8yEv0vf7Azj1WwdE9WreFvfCB1jyU9oI9KLMiPbgribxKdvG9xiW6PWqJ4L0Apb28wBT+O4SfKL00RDu91EDdvcCv4TtQimi8ci7fPayPKL3C3cU9oOfBO1AIZr24hvO80GhovIC1qTrotKi8pPIXPfTR0j249KA89HM5PdAVnj2gudw8XARsPfRIhj2Qnu89rqPpvbQzLz2AmLm7iOa3vMRlRb1I6Jk9gi/qPUTr0L3KT4o9VIawPfD3sjwAAME6pv/EPYDhcjsYaf+80DsXvHxEJD10LAA9AP7cuwyfIT1o5Ak9BmDPvTAo/zzSoZw9UN5qPFDvOryiGsQ9kqnfvQyyab1Ua2e9hjLdPdib972wHUs8Avz3vSCxhrtw1z49kHfvvByC+D0AoNA5OoSCvfwGBD3qIoU9ADSCuVYA2z3KBqK9mHVaPa5dkT1QTn49AFBAuFwoEj281ci9wOXIveCX/rtQV4C8Kha+PXLjuT2IlK09TINqvTD4yL2yIPC9YEw5PVSt5r3ejf+9mGCBvUwk2L3gxUm99imhvT5Wg72sYvM9MPjAvKRc1D2AwjU7EK6DvIznFb3q/ra9xK7NvY5CsT0Yxx29RJj5vVTw6j1A9Rc7ck2rvc46yb0o/Na9lHngveyo5z2mgrA9kIEnPKYu2r0c6gW9LHzwvQxyMD0w8ge9YCHbvDzAH71MDXA98pGKPShR4Dz4OoC8QGRKvAAlD7tOor69Dsz5PRDRXL1K8ZQ9WIOPvQD6WzqIRS894A3rvbTaaj0w9MO9OOWOPPgOy7zCvpI9gs74PUjG5jxA6mm78Kp9vWDkPj3ob3a9hH1TPTjqXb3+pa09eFzEPbD5nD2AHqQ60G9tPYpG6b3um889HAYFvSinOj0YZ628ROwrvSBwcL04IKU90EaLveiTtLykI4E9UGlOPPRl171Yj/69rOt4ve4c7D3KBba9NBeNPbI/tz0AOVS9SBpivfosuL2ouZ882CaPvOAAxzvgFV49QPVWPdSIIb2wqAw8YD/zPIBgLjuw6cw87GdPvSLW0T1gEFK8GASDvGTD5b32kLm9gNN+O3hdnrwutoC93ACGPUBZN7x4EDQ9xJ7XPfRja70A/nu9GMXNvEBtLbyoCoC9oNj1vEAgbLvMqWU9etfsPfyRvT0AwFg88A4BvHQmAz2gNKe78GKGvMgPMD0aSNC9OLbZvQC7BDqsLxu9BD99vURS7r3we6s9YDOju96Kib1oj1C9PJsGPf6oub3wiAM8gAvKulhrLj20G0s93kOnvbATXT1qT8E9YNkDPJprgj041kG9eGXLPAibFT3Ue2y9Eg+ePRwM8r1gU0C9lKCWvZr4l72iH5u9+DnxvVC8rzx4kMq8BI7XvQCgV7hQlKq8sDZTPXCFyL3gCRC9QMbSPLAHWT1Q7ho8SMAKPQTo/z3sXDG9unmuPfKD3D02duK9ILP3PNQCkT0Yu5+8NkmNPSBSizt048I9wGIwO57lo72QasI9YEUYPQbM2T2AM/48FvCHPXKenz2Qbaw8iAvuvMh90zz6frK9wO6LO3CQJL3AewE8srDKvfxrnD1WMOy9dEJbPWqXqD16n+q9cEznPWpOvr1IFMm8nqiEPUxbIr20JOQ9xN5hvfgYibzqV6e9JIhtvQrR+T08h8A9oMsWPEBkKDyKPdm9QETBPdiGmbxUjVW9BrvLvXh60j20yHI9OjKaPaAPVDzKtq29nLtRPbAxbDx00Cs9EPz+vOCecb2WKNI9hKErPcjMT71g4jY8qJfevGAjL7zsjY89TsHLvUCw5z1kTaw9AEDhOOhsUb3wyNA81HKpvfZIpj1qY4e9GKnDPFjc+70QL3U9fkytPQgmwD0QKyc86CaXPXSSLj1+ras9enaQPUr7373w5lc8tIwuvWB6dL20MLM9MI+SvEgSnzxkL6E9vlGsPbyeiD14x7K8cjLkvZDB9b3M7yA9gG7Cum6+ob1wm189Xl7oPWAQlD1IdJC8OF6KPBZLo70MqXE9CmPGvY69sD0I22m94BBLvbZt1r3Yn/e88BlGvCT/a724O7Y9XOuSPbTv4b3w3Ey8ICQsPfT89j342fS8hCqdPUB45bvAX0S9eqmcPXwe5L0WetY9PrP/PdjJC71QQEo9yEj/PThcGj3gOUg90AA8PeR4Ub3o9Pk89nCIvRya2j04Zlu9cBfqPMRQFL1mBoA9AAgHOy7DjD0cpAq9SjmWvRhMRD1uEpC9EC/SvQTRRT1q95m9pHJAvSCw/7xgbBE8YFMxvRBFOL1wrwC9GGezPYxOGT0If3a9dvSwvYDPPTvoBiQ9AG0ruyTclT0AU9c9BBAWPVDbKD2ahZQ9mGYvvYCjtTzW+M49rC11veBkHzzMK0i9MNjEvYaYhz3Sjsw93kyKvRTkPz1oAB09/OpHPTbrjD3W/+492k3CPa4A4L3Mt0i9WvaHPaAkkr3AEck8GH9bvYhgyzxY03k9fO0gPbL3uT1Acna8mvmKPRyGJT2YWyG93s20vYg16j1Upxi9XtPAPbxdoT1g8KS7SHXTvZDfJDzggne96DoFPZSDS70MUMU98vjmvSzVCb24e6E8gF9DPDRQ0j0UxiG9alrMvUp+qT10EQ89YqOoPdiDl71GXJa9JNJOvYCbETz0fi09khyTvUDSQLxI+7C8cpXpPdylOL0AFfg9NAOdvbT5Ur1yjMC9ZJi8PbQLsL0M71M9ECQ8vTwb/z0ocZA8kFDevfA7sDyQ/ng89pr3vdiBzTygP/Q9aFcTPQBDLroIR9S8GA8IPZwaZL2WGfw9Ik3dPXwwbz2EtT69WF/wvUxfk71O6Pg9FvrqvZxu9L1gmxO8mOQiPXjL/r0Kre29ACcyOgS+K72eWbI9NAATPbo23r00vOa99s6vPaiTtbxk+l+9LEUhPYBAybzY3HQ9kNYBPbiuXb1qLs29ZpWKPbzOmb1ghGK8gAKMPMj7lL0Sc4s9NhG0vUCA+zwQCVs8wNs7PSg++72Am+w7ZJp5PUTlo73YY/08AGUAOnYt2T0o1Ni8AN5fOhywXr0oXvy86JISPdzl9r0YNMI9Ahe4PWzUWD0UpL899GAfveg96TwAYtA7ygWxvRDWRL3owzW9ADD9vPJP473OCrS90HtCvCjGm7wQYui9oMvaPP5jiz1IM9U9WHPXPVbisr08FiS9KORyvfjPuzwgMwk9eNPjPEyZlT1UD4c9PmiJvUi9rz2IsKw92IKHPOa53r3mAp29pK4OPSAFMT0Mte49vEqCPTCSOT3As4u7Bo+uPWBcOr1AeFA97NtzvQDsmLpuS5c9dO5qPVjK5bwAdc+6Nh2OvVwobT32Qaw96D0wPbi4970qQre9dmGrPfCekryMN509DLO8PaD6Fb1oM5a93tfwvXzZQz1gTIM92IaxvACI+L1s5KS94LHcu7CtaT3wjyu9QkOlvYg4sr3+DOU9KGg5PcbZz70+GZ69LlHZvYAnlDzM50+9ANrdubj+obxoFuC9qMTkvZqPxr1Ubla9gESfPCDIcL1AAJK74FB1vEof6j3IZ2m9SIXwPRyHxL34ltW9yH8mPaL9lL0AT4M9nqGNvUqXyT384fc9sBwDPGDZ2jyKrO490MKXPSR8370AHoO74BXnvRSOwz3Yj7u8AGlkuqJInb16M4u9MOWEPOA30z3crYC94IVBPKC75z0+buU9sDLIvF7w7z1UdDo9wifpPcANczts9di9UF4LvXyQGT2mhIg9fAf/vSYhxz3CpuW95P6VPSaW/D04Wfw8yELBvHr0jD189he9qKC9vRiutb2wu3A9bIPDPcDbpTsMN/i9Moz7vRA657yYMYo94JiqvUABCj0E7Iu9DEnQPfAoBr2YZtW8WIjgvQxM5b3gaQo8YJKlPPZOij2W2t+9CG2zPDDtk7wkK5Y96M1oveCJGD0IUk49NJmAPUicL71kxCQ9mK/IvPzeCT1Kap29hGvLvY5n0b227aC9TLFYvahsmDyo/N+8ELyRvYCiiTocsCG9Ys6dPc7X0r3Q+zy9mIOkvWC0fDzgdd87YKDru5IA/j3YUUO9wC2TvGhHBD0gqdU9vgrCPeD1aTwItEG9lDMoPUwSoT0A1C67eI2MPQyE0T0gKIm90GHivBJ75r0IEOs83nK2PQjaxrwIZqM89JkjPcC6LrtcBsc9ADiVPFSi+724ZtO9zKL9vYDSqDuoYoo9yBiHvEQs5j14OLi8cFvRPHrY5j08j4E9oKyCu8iV9j1u85i9ILU+PWisoT1Yg5690njwvfjEIz1AP0K9MjCBvdityzyqtbm9VD/mPTDXN7wg+CO93gLWPeSPDj1IGMM8lM10vbT88z1s8Bu9ROzUPaCLFrxSa4A92v+zPbaXvr30n6q9jCX9vaqkuD0GKNw91B47vVjEer1YaKs8OtOJPXDC/DxoadW8zNWivdby2j0CyqW9YF/3vXRtTL2gMcw8RE4+PUD5RT3sTJS9HIBEvRCtY73c8He9Op/Xvcic0TwE5hS9zGb2vZp7lb1ivZm9lNtcvfgunr3QlLG8VHs3PTIvz73wcC+8LFkTvdLhgr2gYOO8aABZvWCtgzsqy7i9sDDCPLgK6z3cH9Q9VI9lvRjQHT3m+PG9monXPd4e/72wxOS9BsvlvUS87b0groo8uGMHvYAX9TzAb/27QPkvu+D5OL0q4pe9YlbWvWYsgT1S/oO9iELQvPyseD0Qm/28zBcBvUipqr2kCNu9OL51PXAI57xc+aA90MoGPAB8Jrn4Hee9AN00O7Br57wYFZK9CP7svEAi1js45MC9QEaqPO4gsj3QSco8kl30Pbjrbj3m5Mm90IdJvRhr9rw4KRk9AKZpu5oAzj2Q6G08pCCivRC1O71o+9S9bCwNvXS6ez2ANp46ah/0vSiE3b2knzk9HrHgvdAwzL2KoZi9kP/zPcSVEb0oGVO9wNqsvdjDoz0QWKW8gHbFPJCf9DzMZRA92NyjPUCO1DsQ11M8UP8EvOLtxr04V+q8KqbzPdRutb1ekKG9SAj+vUBf+DtKce+9KB+DvZDj6z1sDVQ9uGOIPThXrzwqi9m9ZD5uvTo/z73ETJ690FsuPVwBDr3sLfo97py6vRR52r1oxvw9qiXdvaLW2T3I3gk94FTpvYD43j2YYwu95B1TvZS0x71cidi90P3jPGp1+73kZFI9MAr9vDCvMz2Yt/q8IA8xPQDGX7tIfBY9vE1QvawWsL1gaYI8PGajvWqynr1SKfa96DIjvWQOq71cXMc9bHy4PZD18jxWANA9BIl2PWQo8b2w6Uy80DemvA5vm7280hE9UM0fvdzTdL2A/r667jSqvfbg0z3o/aE99lPyPfBetbx4Nyc94L+ku7TV0704o2c9YNCyvYjSOL04SWW95r75vcDqkjtwwac80EEYvK5GvD2gZMQ7GIW6vCaii70sCpi9MJWRvFw/lr1U4Ki90G+HvLDNtLyqRJy9ApSVPZIb2T1MjK69wEJgPcSSbb3wplS8JvruPfAHgzzaFvS9glbrPaBMrbsaMIC9ODKHvUaH2z1AQgo70mWNPRpAqD0suUa9YNQtPFCYpb0UxtU9Dl+HvVYKqj2UuQE9CuudPbBetL0Aw367HqaEPUB+o7uAFeu6AIB5PbpVv734TM28ODZpPRgcez2wxO09UJDKvBig8jzw6nu92NyrvDCEgL2+tr09AJtHOshJUD3Sz4w9GNK+PCDyWTxw5RW85tnYvfj7pDx43OK83izXvdSC7j2AVVq8TIh/vWw4+b20yeu9qPhCPfS6ab2UK129iCCUvR6lzj1wKPa8RO+lPcg7yz0sesa9zvy+PXCKw7xYMPU9qMKCPZj7973IPL48LPszPVC9Ob2iIMI9AgDUvex1Ir2m7PM9jgX6PfzDfz140Zi9QkPcvUYl0L2w/P+85AWRPWwZIj0Atni81jvmPVIHyT24TG+9jLldvYA5wLqQf9Q8AJRquiSqRT1soLA9wKO4vGRwez0IRYs8RIhEPcTHUj1E2Qi9wEdkvcTYWj2E56O9jmaGPURBpL38n689QG9NPVDd+rz2U5I9bJ0ovUgo2jy4vhY9wChRPMCizTzAoCK7LOoTvSzTjj3g8kk9OPk+PVrUrD2+8YW9EOrtvAB/abuKls49BtvLvWjXkr246vO86KzavQBCyr2KXa89wBK/Oy7yzb34FKm84KmGuzQGNr1+Ida9FFOLPaDzfLz08Pk94A/EvXKKjL2gzNS7tEWyvdaQuj2o+MU9UuvnPVyaob3mJLY91L+xPei4S71gumA8iPpzPeIwtz1sGu+9/t3+PWS6AL2gnFA9sP+evcoAxb1EX6299t+WPXCNfL3E0JQ97MgaPWSpSz0ow+O8IPUhvQSOb72MGI+9PgrsPQCa3rtUkFu9BC/uvWAwsjuAHf69gO3Auu6joT2ycpO9GKiMPbBSI71q5MS9aI39veBZfj0c3cO9bP95PXidkjxyIos91m7Avdje3z3o+/69IlDCvSKFmT3gNIs7wsCPvYjM1rzG0uO9kszevfix27xKSsM9AOgYPbgYwTzMsQe9EAHpPQDqnDrU4Cw9gDQCO4DKnzw0vCo9EHPEPQxbkz3YDIM8lLJMPXT5Gb1Q/K49aLoPPbwywT2g4Z+8jgTRvWhJyjxAPVA9dNrOPVxyRj34Kz095LnLPVj0L72QB+I97j+DPez3qj2gk7Y9FibRvfpWhT0kbO49bNizvRCHL7w0PJy9GET3vMCamDzI74g9RKQUvYBp8r0GO4o9tJ+PPWCjubzeJ9s9XlnFPRCy4bwgLJ47wGC0PHCpyLzARvy83B1nvXCVkb0cs389kAgYvUSgdb1SguE9mLijPKy1uD2GSuk9SECQvHC+mDz+WO09EiOwvfiCGb24tpE8UPEKvGBQCD2onIY9dKVSvaB3Hzxcm+c9wNuQvbyZrb2sU8S9uAaZPbbP6r1w/Hi9pOasPZJ3mb3ULtA9dFdvvTj/oTwYC4Y8wO9Iu7pynz0obdk9NtafvcaSjz24zAg9gKcYu0r/sr344Bc9fNC5PR68270Kbuy9ZKv7vVCb7DyIHRO9lAofvWZg7j3wlwK9eJKivWA4ODwugoy9XAMWvQY6hz04Vew8KKyvvci48z02M6095oKuvbAEXz0AZFI9bLG3vUbqs71k+dO9ABJkPQBosjyAYVg9MOJgvRZ+wD3owII89kTMvezeAL1ypYI98CjhPHCnnLws27K94D+fve7O3D1epZK9lmm1PdxfK72AxKM6TEr5vdBuJr2Azdc9MtblvTjPgD0Ucte9aFqVPFIZ6L2MqMq9DqvOvUCJMb3YbIs8KrG7vWTCAT2oL5o93rDQPZis4j0wjKg97MMWveC9PLyYgOI97LJ+PVTHB72eR8E9irnfvSoa2z3IO489HsS7vQTM0L3YMsg9GIz8PQC3Mjx4Dki9CsWRPVD8Zj1AmH+8PvXMPcTupT24SP88JuyEPVbL771E02+9oH9gPBg8Cz3g/Yu8JFNBPWD4Gz2imOy9gH4hPWCDJrxMKrC9YDuKO4DX+7w88oe91Ebpvfoo1j3Id5u94IiJPOIUzT2QAYG8NsmnvU6r970oJKo8fHOAvTBaFTwsiyM9NBERvZqUrT3oQIW8IFVMvUJEqb14Vxs99kWevehA1zwoPYG88u+vPSwBe738OHy9GFaEvDBcnL1oMkM9kIs7vZwPUj1Ok5Q9wnyVPbj8u7xetYs9Jo+HvcAQ/71w6EK8+J25vZRUxr0AJgI9FsLaPTR9Sb2gs+e7eHi5vdD4sjw8+BE9eDCdvLjFwj0sCc69gGOJvBgZjr2MyOA98NXYPb7Q+z0EiOs98MdKPd4FxL0cpq29CHr1PMCO5L3CEaI9mJZePSBS9DxEcd+9CDq6PVDAWLzE2la9/qiFPVARLTwcwmO9mKvvPDS3qr0U7u09IGLgPQggbD1cboc9hnr+vaROjr0kV/a9wG2FvTI+1L0ub7w9eh2KPQLDlj1wS2O9sh7DPcD3k7xEpwS9ttaJPQCIqT26/re9NLjzPSC0Try8XQg9mOj+vaD+YzyoZX29wkqgvfzFVb0Aoxi69NsRvfr9o73ESrc90FEYPbg+7r1QzdY8cIv7PICCljtIp/g8sHcrvGDrXz0COLS9tE5avWzFvz02mp69DDR7Pabe7D3SFuq9QE9gvbx22j1ArPe7yCbKPDi8kTyo/lI90PVSvSDwhDzgYa49UMYsvGje6r28+TA92LQCvSAI2LxWg4U9qHWzPCTemr3YRWy9aKibvKj+/LzQx9i8cvquvQB0uT1mxIQ9EBXKPADb5zxwwW88gGu/PTi25zzw/Js83LmMvYDMKj38f++9mHohPejl3b0A51O9/CaHPQh6mL2Q2Ms9+nGNvRp78j34zR09mOBdvQYhnD00tuK9dCyivfRioL2gzIY8oDNJPPwv3L2qB/c9AIj6uAK0iL0ArUM7GMdbvbhBDT1IWTk9CDwRvQDK7jtyUpg9qoKmvfhW5LywEJe8dl+pvdDNJjzgiZY7TsfOvWgP0jzqV/Q9MCqIPTjdir14Veo9DvmvvYApgr301mE9mqjLPRhM9D2MZdw9HveMvYhR6jz6vqC9AOg0O+YY1D3EGnw9OmLsvcxZXL1q/9e9RDBxPeD9gbxSJLu9RJsjvSgFKD1gmj086DTwPYCF2bqYDSE9QBkbvUBidDygu5I7MubbPYyIVj1y5JG9gHjjvYCR873g7zm9GF6EPAzW8D2wOUm88C9IPQ4bgj2aGMS9ZsTTvUgBQj3gpW49vGduvRh4oDwEp/q9AITOOngB+zyAFZs6GIqivAwcVT1Quwy9lpC+PRaA3L2eTZK9nLfVveyG571Wyb09iGn9vEoYyb0wY9Q8hNvBvWC80ztIZXM9GIjYvHyagz2oK9I8umzNvaiKyTw4B6U9KGLtvBCOQTzIooI8oBwwPAQYBT0MHPW9KjvCPWROXz2g6Hw8wFO6PK50zr3MLxK9oCmyuxBq8zxcboy9QE1ZPOTlHr1QVro9kL3bvVAVVjxKcK09pNTGvUDLartol2w93JpOPWDYcDwA+E498HSyvfg31T1AtTY79nqlPXiH4jyw1WO8DE9bPVwF8z3Qhfw9rnzXvYBr+DuC57e9ciiVPe7Htz04w7O9ILvsu4IlsT1mS6k9hnrAvdriqz3YSbW8jLjZvdj6yzx8hW49UIeZPW4Prr2Warm9EAGsvQ4UkT06vd+9gCiKuux0Fr2kil894BjJPBRGgb3Q27I8qpbrPViYqDz0t329QCKJO7rQ6r2kP6S9uDS+vN6Gn73eyNg92MTGPGxIxj2ILOm8uGmOvEwmAT3kPBi95IYuvTYh+71W28A9/K/nPah4/b1IZim9pKLBvXjVT71C5cI9lPCIPZDoHrwUrVo9cOcYPVzOiz3AuM29TEMePbJ08r3EXKi9hMw+vRCJR7yilvG9QOBLOwB9ozwIMku9oBEmPeKy3z0I6q68EleIvabF4r2S7rq9JJeNvRRBvb0AS0m9ygaNPVQ3ID0sveY9Niv+PexfOL1Mgki9GCGMPCbZy71GPos9IEy4vDBb1r16RsG9yGawvWy5DD32PcQ9EtHKPVT7DL36spS9VD5jvergrr00AQS9VDTnvdTUiD0s8vC9+D6fvTrNqz2Ifb+9YM30PATAvz28V/w9ioiBPURnCb2YSZI94C2Hu8TeHb0AcNU5SLHlPDCnqz1U61Y9oHl0PRgwmTyAKM67uPxWPYBL9jzC9vS9MI6lPARgY72awYe9hAFGPXhl0TxYaK08ZOJyvfiUbD0QPfA94It6PAxyUj2SmOC91jCYPdjcMT2cq2Y9pIJVPSirBr3g3PW72p73PQxTuz1yf7e90B3LPX7H/j3oqoY8BLrHvSh+xjzQzs68hg+4PfL19b3IBQM9gCrAunA5ITywGbA9gPwTO8YZzr2aVZW9vAFNvYBrWjyslEU9+CK/vEATSr04q2A9LOn4vVTjsj0AE2683iGyPepvwT0QyFo8qPUhPZbLkL2Aa7c95tWVPQjUoLzgkEc9IG7lu6ACyD0gw1I90qK6Pdiy6L16bfk9/MI+PdjseD1YLeQ8MiOoPQAB8T1QeC68ng3SvU4T6z3w89e86Ox2vQaXnT083o49aBiJPMCOALxg5MO8lrrqPRb6mz0KdZg94D6jPeD6hb1oztU8hHbdvRC7lD3Kv/299Nj/vSgN/b3s3Z09oCJVPAAIlTlA36I8XMRBvcR5G72IcKy9ABT6vLKGnb1AiVc7DCTJPRqi0710yXs9jGm+vUQiVL3IPMg8YDKwPIDw0T0AIES4MAFDvTi/U71ALHA7yPS/vQy4yL3kEFu9QHBSOyjjrL0gIpK9ZMi2PQ6T7D1gYCC9zKHbvWAFRL30pE49wComPUi4Hr3UduG9yPMZvQj25Ly+a5M9rOJ9vWikmT04DI484J6rvGAk5L2Mvfw9sJi2vCgToT20a4S9+Ez5veAOzL08MoO9RA4jvUCakLz2gdU9IhnsvTiMfz3eZ9c9AOdSOgKnn73gAYM7wO7yPDiKYj3YoRu9KLQvvfCLcb1Ym/e9pNEzPTCKwb0w93W9gJqouvhZxT1qnuM9RjS6vYYG3j3oUeU9WM7OPaBNMjz4ms09bMN4Pfyxt72I7oa9gBAaOwZstb2klyi92mXOPXBgbj3y8d49ADV7OtyIgr3ebqk9sPsWPAhyrDzw7li9kFBSPV4Rvb0wSMw9svXfPay9OD2YWsc9RGKbPayKQ72QCd69kL+GPH68oD1wg1G8QFIsPNa+vT2kZlM9DGK/PYhcljzwkWU8MPD0vHDMrLwiDoi92CerPQx86T3IAj49AMRoO4gDKb3Iwfy9CJy9vGq8tb3A/ry90MTKvDhxybwwkc48xo25vQT6tz1aE+m90HpyvbhhQr0AiPw7pKZTPajtBr2I0J88sGryvPBfSb3gO4+8kCzOPHaq+L3kL7K9FADIPciEZz3ACFu7YFqBOxBZjTwYAO488MeuvZiQC71c8+q9eEPJvcirwLywNIe8ujrIPRhhsDyICaa8gPRiu1r5jj30GBu9MG6/vOhrzbx0bs698B2PvDao7L3Qmom9kvKivXazvj260uu9Bqr2PRz5Pz3KAK295BfUPfCl4bwE1Ni9gDSOvBwJfT3s5/i9MHkZvPxSUD0Uike9AIc6PByqSL32v6u96HvIPbDFtb0AFcC60IYqPaoQj70EN3c99JjUvTh+9D0UBmQ9wPiQvGzz1L3AoXw7dJw1PTgJi71w9YC8oh//vYjs/70QbF689jTWPcDHwLukhCA9jKdMvYAuJ73wHGG8iGqBvWimnD0ypJ89uAPHvUwKHT2AglO9FjaTvVDaebyYzR69kMORvcDpljw4HpI9mAKevJBCD7wgHRo87AtcvYKHhz2qNOw94C07vBA4Czy6RM492q3RPTxwvr3IG229LB77vTzMnD0Sz8c9KFk6vWw8JD04DPg8aEDcvXR1TD2QOns9gCk0O8AFUjyI8+08qmy4Pa4x4j0oLZM8UD5aPczzBb3aoJg9YGVJvZwE072kN3A92OQ9PfBj4TwE11k9gLRzPOhALj2coVA9KBmKveB227uIUZo8eHebvJ49172QRUI8rnOcPY7oiL3QV/s9yIfpPMzBWT3YtEW9TGnRvcyLPr3AR3o7EE5pvSr84z0+2aO9JmysvfybNb3Aq+U9VB1qvW7V7D0YDXY98JabvLxnhD24aHM9TE2CvdDQ0rzI9/c9IsWSPUASer3Qqwm9aHyPPV72gT1AVyI8srikvSDRvL2AIti83D48PXBWWryACda9IPb6vMyH/z3EltO9Lq7Gvd7toD3IuP49NEP2vUiJ571YGCC9rj3/PWJLkb1gGi88zPrQPahANb1AAx298tWrvaBEnTvk8e49CF1RPZrwsz3Arge8kKaivBjxtrxAApI9YEaGvJKs2r20yTO9sF9IPdiX+T1AMrq81OPevVR/vL0obMm9lGNOPXi0vD2Iahc99IgwPWzHpj1MCK89qt2YPbgnjz3Aigo9RCOEPYaor71+sqW92LIJPWhbnzwkDuG93n66vZjLy71EUss9Vl+nPea+hr2IgJo8CIfrvCqM3j083ue9JsO6vf4i1b2K/JQ9RPF/veR5mD2YEi09BEN6vYTtCb2QMk+9mOFhPRhUTb3IwS09AE8SPHhxzL227KC98oCxvYYkhj2w4d08wPpNu9ZumL2Opf29mDA1vXztw71Iov69oin0vcA3p7023vi9hJofPYyTPz3oXk49wNj+vc5Mnj2IpMc8EueCPeis+7yw3nU9VMvyvRRkLj2s/8o9lIWUUpRLAE1CE4WUSwGFlImMC2NvbGxlY3Rpb25zlIwLT3JkZXJlZERpY3SUk5QpUpR0lFKULg=="
160
+ },
161
+ "processes": null,
162
+ "old_count": 0,
163
+ "n_params": 4930
164
+ }
ars-ReacherBulletEnv-v0/policy.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79119d151f8014c22c7f595219d559b8baf6c75ffd0e3e6ccfdb15d26422c64c
3
+ size 21847
ars-ReacherBulletEnv-v0/pytorch_variables.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d030ad8db708280fcae77d87e973102039acd23a11bdecc3db8eb6c0ac940ee1
3
+ size 431
ars-ReacherBulletEnv-v0/system_info.txt ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - OS: Linux-5.19.0-32-generic-x86_64-with-glibc2.35 # 33~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Mon Jan 30 17:03:34 UTC 2
2
+ - Python: 3.9.12
3
+ - Stable-Baselines3: 1.8.0a6
4
+ - PyTorch: 1.13.1+cu117
5
+ - GPU Enabled: True
6
+ - Numpy: 1.24.1
7
+ - Gym: 0.21.0
config.yml ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ !!python/object/apply:collections.OrderedDict
2
+ - - - alive_bonus_offset
3
+ - 0
4
+ - - delta_std
5
+ - 0.03
6
+ - - learning_rate
7
+ - 0.02
8
+ - - n_delta
9
+ - 8
10
+ - - n_envs
11
+ - 1
12
+ - - n_timesteps
13
+ - 1000000.0
14
+ - - n_top
15
+ - 8
16
+ - - normalize
17
+ - dict(norm_obs=True, norm_reward=False)
18
+ - - policy
19
+ - MlpPolicy
20
+ - - policy_kwargs
21
+ - dict(net_arch=[64, 64])
22
+ - - zero_policy
23
+ - false
env_kwargs.yml ADDED
@@ -0,0 +1 @@
 
 
1
+ {}
replay.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:621cfab44aa30997b89a9d2d0787253f944f0db74d76fd206679705f3a19451c
3
+ size 64657
results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"mean_reward": -4.1762833, "std_reward": 11.260917707455402, "is_deterministic": true, "n_eval_episodes": 10, "eval_datetime": "2023-02-27T15:00:32.471856"}
train_eval_metrics.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a8c93115b5716ee07f4aa4b88390bd3133f543d85f752a8395b465f086decfa
3
+ size 175434
vec_normalize.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51e2ae88e28f022f570e41569218e15af217254a7765e45e3ecb7ee1c7c2d165
3
+ size 4251