| 2023-04-17 14:18:11 - r - INFO: - Hyperparameters: | |
| 2023-04-17 14:18:11 - r - INFO: - ================================================================================ | |
| 2023-04-17 14:18:11 - r - INFO: - Name Value Type | |
| 2023-04-17 14:18:11 - r - INFO: - env_name gym <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - new_step_api 1 <class 'bool'> | |
| 2023-04-17 14:18:11 - r - INFO: - wrapper None <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - render 0 <class 'bool'> | |
| 2023-04-17 14:18:11 - r - INFO: - render_mode None <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - algo_name BCQ <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - mode train <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - mp_backend mp <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - seed 0 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - device cpu <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - train_eps 1000 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - test_eps 20 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - eval_eps 10 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - eval_per_episode 5 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - max_steps 200 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - load_checkpoint 0 <class 'bool'> | |
| 2023-04-17 14:18:11 - r - INFO: - load_path tasks <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - show_fig 0 <class 'bool'> | |
| 2023-04-17 14:18:11 - r - INFO: - save_fig 1 <class 'bool'> | |
| 2023-04-17 14:18:11 - r - INFO: - critic_hidden_dims [400, 300] <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - actor_hidden_dims [400, 300] <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - vae_hidden_dims [750, 750] <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - critic_lr 0.001 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - actor_lr 0.001 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - vae_lr 0.001 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - batch_size 128 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - gamma 0.99 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - tau 0.005 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - lmbda 0.75 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - phi 0.05 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - iters_per_ep 10 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - buffer_size 100000 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - start_learn_buffer_size 1000.0 <class 'float'> | |
| 2023-04-17 14:18:11 - r - INFO: - collect_explore_data 1 <class 'bool'> | |
| 2023-04-17 14:18:11 - r - INFO: - behavior_agent_name DDPG <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - behavior_agent_parameters_path /behave_param.yaml <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - behavior_policy_path /behaviour_models <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - collect_eps 500 <class 'int'> | |
| 2023-04-17 14:18:11 - r - INFO: - id HalfCheetah-v3 <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - task_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Train_gym_BCQ_20230417-141811 <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - res_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Train_gym_BCQ_20230417-141811/results <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - log_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Train_gym_BCQ_20230417-141811/logs <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - traj_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Train_gym_BCQ_20230417-141811/traj <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - video_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Train_gym_BCQ_20230417-141811/videos <class 'str'> | |
| 2023-04-17 14:18:11 - r - INFO: - ================================================================================ | |
| 2023-04-17 14:18:11 - r - INFO: - action_bound: 1.0 | |
| 2023-04-17 14:18:11 - r - INFO: - n_states: 17, n_actions: 6 | |
| 2023-04-17 14:18:11 - r - INFO: - Start training! | |
| 2023-04-17 14:18:11 - r - INFO: - Env: gym, Algorithm: BCQ, Device: cpu | |
| 2023-04-17 14:18:13 - r - INFO: - Episode: 1/1000, Reward: 36.767, Step: 200 | |
| 2023-04-17 14:18:13 - r - INFO: - Episode: 2/1000, Reward: 21.783, Step: 200 | |
| 2023-04-17 14:18:13 - r - INFO: - Episode: 3/1000, Reward: -60.802, Step: 200 | |
| 2023-04-17 14:18:14 - r - INFO: - Episode: 4/1000, Reward: -30.031, Step: 200 | |
| 2023-04-17 14:18:14 - r - INFO: - Episode: 5/1000, Reward: 68.186, Step: 200 | |
| 2023-04-17 14:18:16 - r - INFO: - Current episode 5 has the best eval reward: 42.989 | |
| 2023-04-17 14:18:17 - r - INFO: - Episode: 6/1000, Reward: 434.885, Step: 200 | |
| 2023-04-17 14:18:17 - r - INFO: - Episode: 7/1000, Reward: -39.494, Step: 200 | |
| 2023-04-17 14:18:18 - r - INFO: - Episode: 8/1000, Reward: -8.455, Step: 200 | |
| 2023-04-17 14:18:18 - r - INFO: - Episode: 9/1000, Reward: 47.446, Step: 200 | |
| 2023-04-17 14:18:19 - r - INFO: - Episode: 10/1000, Reward: -39.634, Step: 200 | |
| 2023-04-17 14:18:22 - r - INFO: - Episode: 11/1000, Reward: 7.466, Step: 200 | |
| 2023-04-17 14:18:22 - r - INFO: - Episode: 12/1000, Reward: -26.828, Step: 200 | |
| 2023-04-17 14:18:23 - r - INFO: - Episode: 13/1000, Reward: 137.514, Step: 200 | |
| 2023-04-17 14:18:23 - r - INFO: - Episode: 14/1000, Reward: -23.069, Step: 200 | |
| 2023-04-17 14:18:24 - r - INFO: - Episode: 15/1000, Reward: 76.067, Step: 200 | |
| 2023-04-17 14:18:26 - r - INFO: - Current episode 15 has the best eval reward: 70.009 | |
| 2023-04-17 14:18:26 - r - INFO: - Episode: 16/1000, Reward: -3.251, Step: 200 | |
| 2023-04-17 14:18:26 - r - INFO: - Episode: 17/1000, Reward: 65.348, Step: 200 | |
| 2023-04-17 14:18:27 - r - INFO: - Episode: 18/1000, Reward: -11.215, Step: 200 | |
| 2023-04-17 14:18:27 - r - INFO: - Episode: 19/1000, Reward: 11.328, Step: 200 | |
| 2023-04-17 14:18:28 - r - INFO: - Episode: 20/1000, Reward: 199.265, Step: 200 | |
| 2023-04-17 14:18:30 - r - INFO: - Current episode 20 has the best eval reward: 151.140 | |
| 2023-04-17 14:18:30 - r - INFO: - Episode: 21/1000, Reward: 408.710, Step: 200 | |
| 2023-04-17 14:18:30 - r - INFO: - Episode: 22/1000, Reward: 338.869, Step: 200 | |
| 2023-04-17 14:18:31 - r - INFO: - Episode: 23/1000, Reward: -32.201, Step: 200 | |
| 2023-04-17 14:18:31 - r - INFO: - Episode: 24/1000, Reward: 367.254, Step: 200 | |
| 2023-04-17 14:18:32 - r - INFO: - Episode: 25/1000, Reward: 134.399, Step: 200 | |
| 2023-04-17 14:18:34 - r - INFO: - Episode: 26/1000, Reward: 28.196, Step: 200 | |
| 2023-04-17 14:18:34 - r - INFO: - Episode: 27/1000, Reward: 76.629, Step: 200 | |
| 2023-04-17 14:18:35 - r - INFO: - Episode: 28/1000, Reward: 193.268, Step: 200 | |
| 2023-04-17 14:18:35 - r - INFO: - Episode: 29/1000, Reward: 227.018, Step: 200 | |
| 2023-04-17 14:18:36 - r - INFO: - Episode: 30/1000, Reward: 276.609, Step: 200 | |
| 2023-04-17 14:18:38 - r - INFO: - Current episode 30 has the best eval reward: 169.620 | |
| 2023-04-17 14:18:38 - r - INFO: - Episode: 31/1000, Reward: 22.316, Step: 200 | |
| 2023-04-17 14:18:38 - r - INFO: - Episode: 32/1000, Reward: 94.406, Step: 200 | |
| 2023-04-17 14:18:39 - r - INFO: - Episode: 33/1000, Reward: -31.564, Step: 200 | |
| 2023-04-17 14:18:39 - r - INFO: - Episode: 34/1000, Reward: 31.355, Step: 200 | |
| 2023-04-17 14:18:40 - r - INFO: - Episode: 35/1000, Reward: 403.364, Step: 200 | |
| 2023-04-17 14:18:42 - r - INFO: - Current episode 35 has the best eval reward: 187.440 | |
| 2023-04-17 14:18:42 - r - INFO: - Episode: 36/1000, Reward: 574.459, Step: 200 | |
| 2023-04-17 14:18:43 - r - INFO: - Episode: 37/1000, Reward: 280.111, Step: 200 | |
| 2023-04-17 14:18:43 - r - INFO: - Episode: 38/1000, Reward: -94.247, Step: 200 | |
| 2023-04-17 14:18:43 - r - INFO: - Episode: 39/1000, Reward: 125.289, Step: 200 | |
| 2023-04-17 14:18:44 - r - INFO: - Episode: 40/1000, Reward: 775.172, Step: 200 | |
| 2023-04-17 14:18:46 - r - INFO: - Current episode 40 has the best eval reward: 192.895 | |
| 2023-04-17 14:18:46 - r - INFO: - Episode: 41/1000, Reward: 13.564, Step: 200 | |
| 2023-04-17 14:18:47 - r - INFO: - Episode: 42/1000, Reward: 23.385, Step: 200 | |
| 2023-04-17 14:18:47 - r - INFO: - Episode: 43/1000, Reward: 348.051, Step: 200 | |
| 2023-04-17 14:18:48 - r - INFO: - Episode: 44/1000, Reward: 165.466, Step: 200 | |
| 2023-04-17 14:18:48 - r - INFO: - Episode: 45/1000, Reward: 113.787, Step: 200 | |
| 2023-04-17 14:18:51 - r - INFO: - Episode: 46/1000, Reward: 164.293, Step: 200 | |
| 2023-04-17 14:18:52 - r - INFO: - Episode: 47/1000, Reward: 192.775, Step: 200 | |
| 2023-04-17 14:18:52 - r - INFO: - Episode: 48/1000, Reward: 109.055, Step: 200 | |
| 2023-04-17 14:18:52 - r - INFO: - Episode: 49/1000, Reward: -26.554, Step: 200 | |
| 2023-04-17 14:18:53 - r - INFO: - Episode: 50/1000, Reward: 321.206, Step: 200 | |
| 2023-04-17 14:18:56 - r - INFO: - Current episode 50 has the best eval reward: 238.171 | |
| 2023-04-17 14:18:56 - r - INFO: - Episode: 51/1000, Reward: 252.379, Step: 200 | |
| 2023-04-17 14:18:57 - r - INFO: - Episode: 52/1000, Reward: 53.372, Step: 200 | |
| 2023-04-17 14:18:57 - r - INFO: - Episode: 53/1000, Reward: 227.691, Step: 200 | |
| 2023-04-17 14:18:58 - r - INFO: - Episode: 54/1000, Reward: 99.686, Step: 200 | |
| 2023-04-17 14:18:58 - r - INFO: - Episode: 55/1000, Reward: 125.093, Step: 200 | |
| 2023-04-17 14:19:02 - r - INFO: - Episode: 56/1000, Reward: 637.904, Step: 200 | |
| 2023-04-17 14:19:04 - r - INFO: - Episode: 57/1000, Reward: 75.350, Step: 200 | |
| 2023-04-17 14:19:05 - r - INFO: - Episode: 58/1000, Reward: 157.205, Step: 200 | |
| 2023-04-17 14:19:06 - r - INFO: - Episode: 59/1000, Reward: -80.936, Step: 200 | |
| 2023-04-17 14:19:06 - r - INFO: - Episode: 60/1000, Reward: 305.868, Step: 200 | |
| 2023-04-17 14:19:10 - r - INFO: - Episode: 61/1000, Reward: 358.851, Step: 200 | |
| 2023-04-17 14:19:11 - r - INFO: - Episode: 62/1000, Reward: -73.471, Step: 200 | |
| 2023-04-17 14:19:12 - r - INFO: - Episode: 63/1000, Reward: 319.353, Step: 200 | |
| 2023-04-17 14:19:12 - r - INFO: - Episode: 64/1000, Reward: 82.729, Step: 200 | |
| 2023-04-17 14:19:13 - r - INFO: - Episode: 65/1000, Reward: 92.988, Step: 200 | |
| 2023-04-17 14:19:16 - r - INFO: - Episode: 66/1000, Reward: 145.374, Step: 200 | |
| 2023-04-17 14:19:16 - r - INFO: - Episode: 67/1000, Reward: -12.395, Step: 200 | |
| 2023-04-17 14:19:17 - r - INFO: - Episode: 68/1000, Reward: -52.084, Step: 200 | |
| 2023-04-17 14:19:17 - r - INFO: - Episode: 69/1000, Reward: 230.191, Step: 200 | |
| 2023-04-17 14:19:18 - r - INFO: - Episode: 70/1000, Reward: 157.504, Step: 200 | |
| 2023-04-17 14:19:21 - r - INFO: - Episode: 71/1000, Reward: 26.734, Step: 200 | |
| 2023-04-17 14:19:21 - r - INFO: - Episode: 72/1000, Reward: 1077.251, Step: 200 | |
| 2023-04-17 14:19:22 - r - INFO: - Episode: 73/1000, Reward: 316.201, Step: 200 | |
| 2023-04-17 14:19:22 - r - INFO: - Episode: 74/1000, Reward: 186.210, Step: 200 | |
| 2023-04-17 14:19:23 - r - INFO: - Episode: 75/1000, Reward: 330.830, Step: 200 | |
| 2023-04-17 14:19:25 - r - INFO: - Episode: 76/1000, Reward: 62.513, Step: 200 | |
| 2023-04-17 14:19:26 - r - INFO: - Episode: 77/1000, Reward: 94.116, Step: 200 | |
| 2023-04-17 14:19:26 - r - INFO: - Episode: 78/1000, Reward: 105.742, Step: 200 | |
| 2023-04-17 14:19:27 - r - INFO: - Episode: 79/1000, Reward: 318.653, Step: 200 | |
| 2023-04-17 14:19:28 - r - INFO: - Episode: 80/1000, Reward: 221.205, Step: 200 | |
| 2023-04-17 14:19:30 - r - INFO: - Episode: 81/1000, Reward: 394.372, Step: 200 | |
| 2023-04-17 14:19:31 - r - INFO: - Episode: 82/1000, Reward: 130.508, Step: 200 | |
| 2023-04-17 14:19:31 - r - INFO: - Episode: 83/1000, Reward: 352.314, Step: 200 | |
| 2023-04-17 14:19:31 - r - INFO: - Episode: 84/1000, Reward: 119.763, Step: 200 | |
| 2023-04-17 14:19:32 - r - INFO: - Episode: 85/1000, Reward: 197.989, Step: 200 | |
| 2023-04-17 14:19:34 - r - INFO: - Current episode 85 has the best eval reward: 263.313 | |
| 2023-04-17 14:19:34 - r - INFO: - Episode: 86/1000, Reward: 85.460, Step: 200 | |
| 2023-04-17 14:19:35 - r - INFO: - Episode: 87/1000, Reward: 363.022, Step: 200 | |
| 2023-04-17 14:19:35 - r - INFO: - Episode: 88/1000, Reward: 16.903, Step: 200 | |
| 2023-04-17 14:19:36 - r - INFO: - Episode: 89/1000, Reward: 391.962, Step: 200 | |
| 2023-04-17 14:19:37 - r - INFO: - Episode: 90/1000, Reward: 164.657, Step: 200 | |
| 2023-04-17 14:19:40 - r - INFO: - Current episode 90 has the best eval reward: 371.576 | |
| 2023-04-17 14:19:41 - r - INFO: - Episode: 91/1000, Reward: 551.290, Step: 200 | |
| 2023-04-17 14:19:42 - r - INFO: - Episode: 92/1000, Reward: 358.540, Step: 200 | |
| 2023-04-17 14:19:42 - r - INFO: - Episode: 93/1000, Reward: 233.183, Step: 200 | |
| 2023-04-17 14:19:43 - r - INFO: - Episode: 94/1000, Reward: 155.593, Step: 200 | |
| 2023-04-17 14:19:44 - r - INFO: - Episode: 95/1000, Reward: 220.060, Step: 200 | |
| 2023-04-17 14:19:48 - r - INFO: - Episode: 96/1000, Reward: 267.437, Step: 200 | |
| 2023-04-17 14:19:49 - r - INFO: - Episode: 97/1000, Reward: 99.229, Step: 200 | |
| 2023-04-17 14:19:49 - r - INFO: - Episode: 98/1000, Reward: 161.359, Step: 200 | |
| 2023-04-17 14:19:50 - r - INFO: - Episode: 99/1000, Reward: -1.241, Step: 200 | |
| 2023-04-17 14:19:50 - r - INFO: - Episode: 100/1000, Reward: 116.920, Step: 200 | |
| 2023-04-17 14:19:54 - r - INFO: - Episode: 101/1000, Reward: 188.344, Step: 200 | |
| 2023-04-17 14:19:54 - r - INFO: - Episode: 102/1000, Reward: 9.056, Step: 200 | |
| 2023-04-17 14:19:55 - r - INFO: - Episode: 103/1000, Reward: 928.376, Step: 200 | |
| 2023-04-17 14:19:55 - r - INFO: - Episode: 104/1000, Reward: 297.736, Step: 200 | |
| 2023-04-17 14:19:56 - r - INFO: - Episode: 105/1000, Reward: 122.111, Step: 200 | |
| 2023-04-17 14:19:59 - r - INFO: - Episode: 106/1000, Reward: 442.425, Step: 200 | |
| 2023-04-17 14:19:59 - r - INFO: - Episode: 107/1000, Reward: 67.100, Step: 200 | |
| 2023-04-17 14:20:00 - r - INFO: - Episode: 108/1000, Reward: -47.063, Step: 200 | |
| 2023-04-17 14:20:01 - r - INFO: - Episode: 109/1000, Reward: 369.440, Step: 200 | |
| 2023-04-17 14:20:01 - r - INFO: - Episode: 110/1000, Reward: 66.838, Step: 200 | |
| 2023-04-17 14:20:05 - r - INFO: - Episode: 111/1000, Reward: 118.007, Step: 200 | |
| 2023-04-17 14:20:06 - r - INFO: - Episode: 112/1000, Reward: 289.216, Step: 200 | |
| 2023-04-17 14:20:07 - r - INFO: - Episode: 113/1000, Reward: 89.995, Step: 200 | |
| 2023-04-17 14:20:07 - r - INFO: - Episode: 114/1000, Reward: 99.790, Step: 200 | |
| 2023-04-17 14:20:08 - r - INFO: - Episode: 115/1000, Reward: 26.232, Step: 200 | |
| 2023-04-17 14:20:11 - r - INFO: - Episode: 116/1000, Reward: 375.304, Step: 200 | |
| 2023-04-17 14:20:11 - r - INFO: - Episode: 117/1000, Reward: 113.852, Step: 200 | |
| 2023-04-17 14:20:12 - r - INFO: - Episode: 118/1000, Reward: 236.113, Step: 200 | |
| 2023-04-17 14:20:12 - r - INFO: - Episode: 119/1000, Reward: 206.119, Step: 200 | |
| 2023-04-17 14:20:13 - r - INFO: - Episode: 120/1000, Reward: 78.333, Step: 200 | |
| 2023-04-17 14:20:16 - r - INFO: - Episode: 121/1000, Reward: 605.236, Step: 200 | |
| 2023-04-17 14:20:17 - r - INFO: - Episode: 122/1000, Reward: 16.320, Step: 200 | |
| 2023-04-17 14:20:17 - r - INFO: - Episode: 123/1000, Reward: 312.691, Step: 200 | |
| 2023-04-17 14:20:18 - r - INFO: - Episode: 124/1000, Reward: 409.327, Step: 200 | |
| 2023-04-17 14:20:18 - r - INFO: - Episode: 125/1000, Reward: 301.539, Step: 200 | |
| 2023-04-17 14:20:22 - r - INFO: - Episode: 126/1000, Reward: 474.213, Step: 200 | |
| 2023-04-17 14:20:23 - r - INFO: - Episode: 127/1000, Reward: 63.957, Step: 200 | |
| 2023-04-17 14:20:23 - r - INFO: - Episode: 128/1000, Reward: 134.605, Step: 200 | |
| 2023-04-17 14:20:24 - r - INFO: - Episode: 129/1000, Reward: 180.447, Step: 200 | |
| 2023-04-17 14:20:24 - r - INFO: - Episode: 130/1000, Reward: 388.013, Step: 200 | |
| 2023-04-17 14:20:27 - r - INFO: - Current episode 130 has the best eval reward: 523.746 | |
| 2023-04-17 14:20:28 - r - INFO: - Episode: 131/1000, Reward: 125.378, Step: 200 | |
| 2023-04-17 14:20:28 - r - INFO: - Episode: 132/1000, Reward: 332.917, Step: 200 | |
| 2023-04-17 14:20:29 - r - INFO: - Episode: 133/1000, Reward: 251.745, Step: 200 | |
| 2023-04-17 14:20:29 - r - INFO: - Episode: 134/1000, Reward: 787.607, Step: 200 | |
| 2023-04-17 14:20:30 - r - INFO: - Episode: 135/1000, Reward: 139.888, Step: 200 | |
| 2023-04-17 14:20:33 - r - INFO: - Episode: 136/1000, Reward: 224.870, Step: 200 | |
| 2023-04-17 14:20:34 - r - INFO: - Episode: 137/1000, Reward: 410.017, Step: 200 | |
| 2023-04-17 14:20:34 - r - INFO: - Episode: 138/1000, Reward: 224.096, Step: 200 | |
| 2023-04-17 14:20:35 - r - INFO: - Episode: 139/1000, Reward: 701.013, Step: 200 | |
| 2023-04-17 14:20:36 - r - INFO: - Episode: 140/1000, Reward: 960.260, Step: 200 | |
| 2023-04-17 14:20:39 - r - INFO: - Episode: 141/1000, Reward: -34.193, Step: 200 | |
| 2023-04-17 14:20:39 - r - INFO: - Episode: 142/1000, Reward: 63.261, Step: 200 | |
| 2023-04-17 14:20:40 - r - INFO: - Episode: 143/1000, Reward: 166.859, Step: 200 | |
| 2023-04-17 14:20:40 - r - INFO: - Episode: 144/1000, Reward: -62.683, Step: 200 | |
| 2023-04-17 14:20:41 - r - INFO: - Episode: 145/1000, Reward: 213.826, Step: 200 | |
| 2023-04-17 14:20:44 - r - INFO: - Episode: 146/1000, Reward: 94.539, Step: 200 | |
| 2023-04-17 14:20:44 - r - INFO: - Episode: 147/1000, Reward: 117.668, Step: 200 | |
| 2023-04-17 14:20:45 - r - INFO: - Episode: 148/1000, Reward: 99.363, Step: 200 | |
| 2023-04-17 14:20:46 - r - INFO: - Episode: 149/1000, Reward: 480.802, Step: 200 | |
| 2023-04-17 14:20:46 - r - INFO: - Episode: 150/1000, Reward: 182.572, Step: 200 | |
| 2023-04-17 14:20:49 - r - INFO: - Episode: 151/1000, Reward: 3.159, Step: 200 | |
| 2023-04-17 14:20:50 - r - INFO: - Episode: 152/1000, Reward: 146.942, Step: 200 | |
| 2023-04-17 14:20:50 - r - INFO: - Episode: 153/1000, Reward: 43.636, Step: 200 | |
| 2023-04-17 14:20:51 - r - INFO: - Episode: 154/1000, Reward: 33.393, Step: 200 | |
| 2023-04-17 14:20:51 - r - INFO: - Episode: 155/1000, Reward: 591.482, Step: 200 | |
| 2023-04-17 14:20:54 - r - INFO: - Episode: 156/1000, Reward: 169.522, Step: 200 | |
| 2023-04-17 14:20:55 - r - INFO: - Episode: 157/1000, Reward: 486.412, Step: 200 | |
| 2023-04-17 14:20:55 - r - INFO: - Episode: 158/1000, Reward: 429.272, Step: 200 | |
| 2023-04-17 14:20:56 - r - INFO: - Episode: 159/1000, Reward: 626.850, Step: 200 | |
| 2023-04-17 14:20:57 - r - INFO: - Episode: 160/1000, Reward: 193.040, Step: 200 | |
| 2023-04-17 14:21:00 - r - INFO: - Episode: 161/1000, Reward: 305.280, Step: 200 | |
| 2023-04-17 14:21:00 - r - INFO: - Episode: 162/1000, Reward: 537.074, Step: 200 | |
| 2023-04-17 14:21:01 - r - INFO: - Episode: 163/1000, Reward: 614.044, Step: 200 | |
| 2023-04-17 14:21:01 - r - INFO: - Episode: 164/1000, Reward: 16.916, Step: 200 | |
| 2023-04-17 14:21:02 - r - INFO: - Episode: 165/1000, Reward: 162.581, Step: 200 | |
| 2023-04-17 14:21:05 - r - INFO: - Episode: 166/1000, Reward: 187.667, Step: 200 | |
| 2023-04-17 14:21:06 - r - INFO: - Episode: 167/1000, Reward: 87.235, Step: 200 | |
| 2023-04-17 14:21:07 - r - INFO: - Episode: 168/1000, Reward: -62.937, Step: 200 | |
| 2023-04-17 14:21:07 - r - INFO: - Episode: 169/1000, Reward: 23.235, Step: 200 | |
| 2023-04-17 14:21:08 - r - INFO: - Episode: 170/1000, Reward: 863.124, Step: 200 | |
| 2023-04-17 14:21:12 - r - INFO: - Episode: 171/1000, Reward: -27.099, Step: 200 | |
| 2023-04-17 14:21:12 - r - INFO: - Episode: 172/1000, Reward: 323.274, Step: 200 | |
| 2023-04-17 14:21:13 - r - INFO: - Episode: 173/1000, Reward: 245.846, Step: 200 | |
| 2023-04-17 14:21:14 - r - INFO: - Episode: 174/1000, Reward: 27.394, Step: 200 | |
| 2023-04-17 14:21:14 - r - INFO: - Episode: 175/1000, Reward: 292.128, Step: 200 | |
| 2023-04-17 14:21:18 - r - INFO: - Episode: 176/1000, Reward: 225.704, Step: 200 | |
| 2023-04-17 14:21:18 - r - INFO: - Episode: 177/1000, Reward: 568.517, Step: 200 | |
| 2023-04-17 14:21:19 - r - INFO: - Episode: 178/1000, Reward: 277.103, Step: 200 | |
| 2023-04-17 14:21:19 - r - INFO: - Episode: 179/1000, Reward: 438.246, Step: 200 | |
| 2023-04-17 14:21:20 - r - INFO: - Episode: 180/1000, Reward: 130.911, Step: 200 | |
| 2023-04-17 14:21:24 - r - INFO: - Episode: 181/1000, Reward: -31.328, Step: 200 | |
| 2023-04-17 14:21:24 - r - INFO: - Episode: 182/1000, Reward: 156.361, Step: 200 | |
| 2023-04-17 14:21:25 - r - INFO: - Episode: 183/1000, Reward: -87.087, Step: 200 | |
| 2023-04-17 14:21:25 - r - INFO: - Episode: 184/1000, Reward: 26.352, Step: 200 | |
| 2023-04-17 14:21:26 - r - INFO: - Episode: 185/1000, Reward: 283.009, Step: 200 | |
| 2023-04-17 14:21:29 - r - INFO: - Episode: 186/1000, Reward: 131.234, Step: 200 | |
| 2023-04-17 14:21:30 - r - INFO: - Episode: 187/1000, Reward: 352.672, Step: 200 | |
| 2023-04-17 14:21:30 - r - INFO: - Episode: 188/1000, Reward: -49.442, Step: 200 | |
| 2023-04-17 14:21:31 - r - INFO: - Episode: 189/1000, Reward: 261.836, Step: 200 | |
| 2023-04-17 14:21:31 - r - INFO: - Episode: 190/1000, Reward: 121.849, Step: 200 | |
| 2023-04-17 14:21:35 - r - INFO: - Episode: 191/1000, Reward: 259.229, Step: 200 | |
| 2023-04-17 14:21:35 - r - INFO: - Episode: 192/1000, Reward: 2.797, Step: 200 | |
| 2023-04-17 14:21:36 - r - INFO: - Episode: 193/1000, Reward: 88.652, Step: 200 | |
| 2023-04-17 14:21:36 - r - INFO: - Episode: 194/1000, Reward: -112.533, Step: 200 | |
| 2023-04-17 14:21:37 - r - INFO: - Episode: 195/1000, Reward: 590.822, Step: 200 | |
| 2023-04-17 14:21:40 - r - INFO: - Episode: 196/1000, Reward: 246.962, Step: 200 | |
| 2023-04-17 14:21:41 - r - INFO: - Episode: 197/1000, Reward: 152.954, Step: 200 | |
| 2023-04-17 14:21:42 - r - INFO: - Episode: 198/1000, Reward: 120.679, Step: 200 | |
| 2023-04-17 14:21:42 - r - INFO: - Episode: 199/1000, Reward: 673.171, Step: 200 | |
| 2023-04-17 14:21:43 - r - INFO: - Episode: 200/1000, Reward: 522.125, Step: 200 | |
| 2023-04-17 14:21:46 - r - INFO: - Episode: 201/1000, Reward: 340.316, Step: 200 | |
| 2023-04-17 14:21:47 - r - INFO: - Episode: 202/1000, Reward: 67.554, Step: 200 | |
| 2023-04-17 14:21:47 - r - INFO: - Episode: 203/1000, Reward: 134.180, Step: 200 | |
| 2023-04-17 14:21:48 - r - INFO: - Episode: 204/1000, Reward: 262.443, Step: 200 | |
| 2023-04-17 14:21:48 - r - INFO: - Episode: 205/1000, Reward: 233.219, Step: 200 | |
| 2023-04-17 14:21:52 - r - INFO: - Episode: 206/1000, Reward: -81.757, Step: 200 | |
| 2023-04-17 14:21:52 - r - INFO: - Episode: 207/1000, Reward: 102.885, Step: 200 | |
| 2023-04-17 14:21:53 - r - INFO: - Episode: 208/1000, Reward: 347.454, Step: 200 | |
| 2023-04-17 14:21:53 - r - INFO: - Episode: 209/1000, Reward: -32.425, Step: 200 | |
| 2023-04-17 14:21:54 - r - INFO: - Episode: 210/1000, Reward: 704.177, Step: 200 | |
| 2023-04-17 14:21:58 - r - INFO: - Episode: 211/1000, Reward: 227.647, Step: 200 | |
| 2023-04-17 14:21:58 - r - INFO: - Episode: 212/1000, Reward: 451.534, Step: 200 | |
| 2023-04-17 14:21:59 - r - INFO: - Episode: 213/1000, Reward: 676.279, Step: 200 | |
| 2023-04-17 14:22:00 - r - INFO: - Episode: 214/1000, Reward: 401.667, Step: 200 | |
| 2023-04-17 14:22:00 - r - INFO: - Episode: 215/1000, Reward: 377.560, Step: 200 | |
| 2023-04-17 14:22:03 - r - INFO: - Current episode 215 has the best eval reward: 537.317 | |
| 2023-04-17 14:22:04 - r - INFO: - Episode: 216/1000, Reward: 374.650, Step: 200 | |
| 2023-04-17 14:22:04 - r - INFO: - Episode: 217/1000, Reward: 6.814, Step: 200 | |
| 2023-04-17 14:22:05 - r - INFO: - Episode: 218/1000, Reward: 843.697, Step: 200 | |
| 2023-04-17 14:22:05 - r - INFO: - Episode: 219/1000, Reward: 930.712, Step: 200 | |
| 2023-04-17 14:22:06 - r - INFO: - Episode: 220/1000, Reward: 74.585, Step: 200 | |
| 2023-04-17 14:22:09 - r - INFO: - Episode: 221/1000, Reward: -62.471, Step: 200 | |
| 2023-04-17 14:22:10 - r - INFO: - Episode: 222/1000, Reward: 91.411, Step: 200 | |
| 2023-04-17 14:22:11 - r - INFO: - Episode: 223/1000, Reward: 439.858, Step: 200 | |
| 2023-04-17 14:22:11 - r - INFO: - Episode: 224/1000, Reward: 828.926, Step: 200 | |
| 2023-04-17 14:22:12 - r - INFO: - Episode: 225/1000, Reward: 49.018, Step: 200 | |
| 2023-04-17 14:22:15 - r - INFO: - Episode: 226/1000, Reward: 199.457, Step: 200 | |
| 2023-04-17 14:22:16 - r - INFO: - Episode: 227/1000, Reward: 108.963, Step: 200 | |
| 2023-04-17 14:22:17 - r - INFO: - Episode: 228/1000, Reward: -73.162, Step: 200 | |
| 2023-04-17 14:22:17 - r - INFO: - Episode: 229/1000, Reward: 292.108, Step: 200 | |
| 2023-04-17 14:22:18 - r - INFO: - Episode: 230/1000, Reward: 74.100, Step: 200 | |
| 2023-04-17 14:22:21 - r - INFO: - Episode: 231/1000, Reward: 563.871, Step: 200 | |
| 2023-04-17 14:22:22 - r - INFO: - Episode: 232/1000, Reward: -0.594, Step: 200 | |
| 2023-04-17 14:22:22 - r - INFO: - Episode: 233/1000, Reward: 1001.469, Step: 200 | |
| 2023-04-17 14:22:23 - r - INFO: - Episode: 234/1000, Reward: 101.065, Step: 200 | |
| 2023-04-17 14:22:23 - r - INFO: - Episode: 235/1000, Reward: 334.962, Step: 200 | |
| 2023-04-17 14:22:26 - r - INFO: - Current episode 235 has the best eval reward: 632.590 | |
| 2023-04-17 14:22:27 - r - INFO: - Episode: 236/1000, Reward: 616.074, Step: 200 | |
| 2023-04-17 14:22:28 - r - INFO: - Episode: 237/1000, Reward: 534.571, Step: 200 | |
| 2023-04-17 14:22:29 - r - INFO: - Episode: 238/1000, Reward: 159.166, Step: 200 | |
| 2023-04-17 14:22:30 - r - INFO: - Episode: 239/1000, Reward: 1088.036, Step: 200 | |
| 2023-04-17 14:22:31 - r - INFO: - Episode: 240/1000, Reward: 818.456, Step: 200 | |
| 2023-04-17 14:22:35 - r - INFO: - Episode: 241/1000, Reward: 297.688, Step: 200 | |
| 2023-04-17 14:22:35 - r - INFO: - Episode: 242/1000, Reward: 678.415, Step: 200 | |
| 2023-04-17 14:22:36 - r - INFO: - Episode: 243/1000, Reward: 77.522, Step: 200 | |
| 2023-04-17 14:22:37 - r - INFO: - Episode: 244/1000, Reward: 10.843, Step: 200 | |
| 2023-04-17 14:22:37 - r - INFO: - Episode: 245/1000, Reward: 14.063, Step: 200 | |
| 2023-04-17 14:22:40 - r - INFO: - Episode: 246/1000, Reward: 1165.727, Step: 200 | |
| 2023-04-17 14:22:41 - r - INFO: - Episode: 247/1000, Reward: 473.052, Step: 200 | |
| 2023-04-17 14:22:42 - r - INFO: - Episode: 248/1000, Reward: 114.722, Step: 200 | |
| 2023-04-17 14:22:42 - r - INFO: - Episode: 249/1000, Reward: 98.678, Step: 200 | |
| 2023-04-17 14:22:43 - r - INFO: - Episode: 250/1000, Reward: 541.536, Step: 200 | |
| 2023-04-17 14:22:48 - r - INFO: - Episode: 251/1000, Reward: 170.182, Step: 200 | |
| 2023-04-17 14:22:48 - r - INFO: - Episode: 252/1000, Reward: 532.782, Step: 200 | |
| 2023-04-17 14:22:49 - r - INFO: - Episode: 253/1000, Reward: 19.611, Step: 200 | |
| 2023-04-17 14:22:50 - r - INFO: - Episode: 254/1000, Reward: 1142.534, Step: 200 | |
| 2023-04-17 14:22:50 - r - INFO: - Episode: 255/1000, Reward: 1006.831, Step: 200 | |
| 2023-04-17 14:22:56 - r - INFO: - Episode: 256/1000, Reward: 1038.001, Step: 200 | |
| 2023-04-17 14:22:57 - r - INFO: - Episode: 257/1000, Reward: 291.740, Step: 200 | |
| 2023-04-17 14:22:57 - r - INFO: - Episode: 258/1000, Reward: 91.170, Step: 200 | |
| 2023-04-17 14:22:58 - r - INFO: - Episode: 259/1000, Reward: 325.686, Step: 200 | |
| 2023-04-17 14:22:59 - r - INFO: - Episode: 260/1000, Reward: 93.240, Step: 200 | |
| 2023-04-17 14:23:03 - r - INFO: - Episode: 261/1000, Reward: 28.747, Step: 200 | |
| 2023-04-17 14:23:03 - r - INFO: - Episode: 262/1000, Reward: 447.162, Step: 200 | |
| 2023-04-17 14:23:04 - r - INFO: - Episode: 263/1000, Reward: 292.820, Step: 200 | |
| 2023-04-17 14:23:05 - r - INFO: - Episode: 264/1000, Reward: 51.004, Step: 200 | |
| 2023-04-17 14:23:05 - r - INFO: - Episode: 265/1000, Reward: 1314.805, Step: 200 | |
| 2023-04-17 14:23:09 - r - INFO: - Episode: 266/1000, Reward: 274.492, Step: 200 | |
| 2023-04-17 14:23:09 - r - INFO: - Episode: 267/1000, Reward: 242.027, Step: 200 | |
| 2023-04-17 14:23:10 - r - INFO: - Episode: 268/1000, Reward: 754.570, Step: 200 | |
| 2023-04-17 14:23:11 - r - INFO: - Episode: 269/1000, Reward: 76.262, Step: 200 | |
| 2023-04-17 14:23:11 - r - INFO: - Episode: 270/1000, Reward: 382.932, Step: 200 | |
| 2023-04-17 14:23:16 - r - INFO: - Episode: 271/1000, Reward: 183.575, Step: 200 | |
| 2023-04-17 14:23:16 - r - INFO: - Episode: 272/1000, Reward: 906.285, Step: 200 | |
| 2023-04-17 14:23:17 - r - INFO: - Episode: 273/1000, Reward: 663.803, Step: 200 | |
| 2023-04-17 14:23:18 - r - INFO: - Episode: 274/1000, Reward: 112.702, Step: 200 | |
| 2023-04-17 14:23:18 - r - INFO: - Episode: 275/1000, Reward: 163.363, Step: 200 | |
| 2023-04-17 14:23:22 - r - INFO: - Episode: 276/1000, Reward: 728.186, Step: 200 | |
| 2023-04-17 14:23:22 - r - INFO: - Episode: 277/1000, Reward: 654.437, Step: 200 | |
| 2023-04-17 14:23:23 - r - INFO: - Episode: 278/1000, Reward: 455.033, Step: 200 | |
| 2023-04-17 14:23:23 - r - INFO: - Episode: 279/1000, Reward: 789.555, Step: 200 | |
| 2023-04-17 14:23:24 - r - INFO: - Episode: 280/1000, Reward: -71.630, Step: 200 | |
| 2023-04-17 14:23:28 - r - INFO: - Current episode 280 has the best eval reward: 645.866 | |
| 2023-04-17 14:23:29 - r - INFO: - Episode: 281/1000, Reward: 86.629, Step: 200 | |
| 2023-04-17 14:23:30 - r - INFO: - Episode: 282/1000, Reward: 502.362, Step: 200 | |
| 2023-04-17 14:23:30 - r - INFO: - Episode: 283/1000, Reward: 229.235, Step: 200 | |
| 2023-04-17 14:23:31 - r - INFO: - Episode: 284/1000, Reward: 39.444, Step: 200 | |
| 2023-04-17 14:23:31 - r - INFO: - Episode: 285/1000, Reward: 969.390, Step: 200 | |
| 2023-04-17 14:23:34 - r - INFO: - Episode: 286/1000, Reward: -49.349, Step: 200 | |
| 2023-04-17 14:23:35 - r - INFO: - Episode: 287/1000, Reward: 557.668, Step: 200 | |
| 2023-04-17 14:23:35 - r - INFO: - Episode: 288/1000, Reward: 180.889, Step: 200 | |
| 2023-04-17 14:23:36 - r - INFO: - Episode: 289/1000, Reward: 1270.018, Step: 200 | |
| 2023-04-17 14:23:36 - r - INFO: - Episode: 290/1000, Reward: -52.145, Step: 200 | |
| 2023-04-17 14:23:40 - r - INFO: - Episode: 291/1000, Reward: 338.981, Step: 200 | |
| 2023-04-17 14:23:40 - r - INFO: - Episode: 292/1000, Reward: -10.908, Step: 200 | |
| 2023-04-17 14:23:41 - r - INFO: - Episode: 293/1000, Reward: 845.803, Step: 200 | |
| 2023-04-17 14:23:41 - r - INFO: - Episode: 294/1000, Reward: 896.835, Step: 200 | |
| 2023-04-17 14:23:42 - r - INFO: - Episode: 295/1000, Reward: 403.896, Step: 200 | |
| 2023-04-17 14:23:45 - r - INFO: - Episode: 296/1000, Reward: 66.396, Step: 200 | |
| 2023-04-17 14:23:46 - r - INFO: - Episode: 297/1000, Reward: 207.754, Step: 200 | |
| 2023-04-17 14:23:46 - r - INFO: - Episode: 298/1000, Reward: 632.779, Step: 200 | |
| 2023-04-17 14:23:47 - r - INFO: - Episode: 299/1000, Reward: 361.880, Step: 200 | |
| 2023-04-17 14:23:47 - r - INFO: - Episode: 300/1000, Reward: 1098.759, Step: 200 | |
| 2023-04-17 14:23:51 - r - INFO: - Episode: 301/1000, Reward: 125.698, Step: 200 | |
| 2023-04-17 14:23:51 - r - INFO: - Episode: 302/1000, Reward: 105.351, Step: 200 | |
| 2023-04-17 14:23:52 - r - INFO: - Episode: 303/1000, Reward: -51.808, Step: 200 | |
| 2023-04-17 14:23:52 - r - INFO: - Episode: 304/1000, Reward: 122.586, Step: 200 | |
| 2023-04-17 14:23:53 - r - INFO: - Episode: 305/1000, Reward: 131.504, Step: 200 | |
| 2023-04-17 14:23:57 - r - INFO: - Episode: 306/1000, Reward: -54.181, Step: 200 | |
| 2023-04-17 14:23:58 - r - INFO: - Episode: 307/1000, Reward: 1209.181, Step: 200 | |
| 2023-04-17 14:23:58 - r - INFO: - Episode: 308/1000, Reward: -49.109, Step: 200 | |
| 2023-04-17 14:23:59 - r - INFO: - Episode: 309/1000, Reward: 229.582, Step: 200 | |
| 2023-04-17 14:24:00 - r - INFO: - Episode: 310/1000, Reward: 1087.966, Step: 200 | |
| 2023-04-17 14:24:04 - r - INFO: - Episode: 311/1000, Reward: 649.488, Step: 200 | |
| 2023-04-17 14:24:04 - r - INFO: - Episode: 312/1000, Reward: -19.740, Step: 200 | |
| 2023-04-17 14:24:05 - r - INFO: - Episode: 313/1000, Reward: 588.880, Step: 200 | |
| 2023-04-17 14:24:05 - r - INFO: - Episode: 314/1000, Reward: 515.671, Step: 200 | |
| 2023-04-17 14:24:06 - r - INFO: - Episode: 315/1000, Reward: 47.394, Step: 200 | |
| 2023-04-17 14:24:09 - r - INFO: - Episode: 316/1000, Reward: -27.627, Step: 200 | |
| 2023-04-17 14:24:10 - r - INFO: - Episode: 317/1000, Reward: 1056.537, Step: 200 | |
| 2023-04-17 14:24:11 - r - INFO: - Episode: 318/1000, Reward: 454.216, Step: 200 | |
| 2023-04-17 14:24:11 - r - INFO: - Episode: 319/1000, Reward: 963.842, Step: 200 | |
| 2023-04-17 14:24:12 - r - INFO: - Episode: 320/1000, Reward: -12.392, Step: 200 | |
| 2023-04-17 14:24:15 - r - INFO: - Current episode 320 has the best eval reward: 655.069 | |
| 2023-04-17 14:24:15 - r - INFO: - Episode: 321/1000, Reward: -21.301, Step: 200 | |
| 2023-04-17 14:24:16 - r - INFO: - Episode: 322/1000, Reward: 905.088, Step: 200 | |
| 2023-04-17 14:24:17 - r - INFO: - Episode: 323/1000, Reward: 43.727, Step: 200 | |
| 2023-04-17 14:24:17 - r - INFO: - Episode: 324/1000, Reward: 1173.265, Step: 200 | |
| 2023-04-17 14:24:18 - r - INFO: - Episode: 325/1000, Reward: 148.092, Step: 200 | |
| 2023-04-17 14:24:21 - r - INFO: - Episode: 326/1000, Reward: 1195.893, Step: 200 | |
| 2023-04-17 14:24:22 - r - INFO: - Episode: 327/1000, Reward: 47.574, Step: 200 | |
| 2023-04-17 14:24:23 - r - INFO: - Episode: 328/1000, Reward: -79.854, Step: 200 | |
| 2023-04-17 14:24:23 - r - INFO: - Episode: 329/1000, Reward: 28.465, Step: 200 | |
| 2023-04-17 14:24:24 - r - INFO: - Episode: 330/1000, Reward: 671.698, Step: 200 | |
| 2023-04-17 14:24:27 - r - INFO: - Current episode 330 has the best eval reward: 689.900 | |
| 2023-04-17 14:24:27 - r - INFO: - Episode: 331/1000, Reward: -23.250, Step: 200 | |
| 2023-04-17 14:24:28 - r - INFO: - Episode: 332/1000, Reward: 451.186, Step: 200 | |
| 2023-04-17 14:24:28 - r - INFO: - Episode: 333/1000, Reward: 592.159, Step: 200 | |
| 2023-04-17 14:24:29 - r - INFO: - Episode: 334/1000, Reward: 1009.069, Step: 200 | |
| 2023-04-17 14:24:30 - r - INFO: - Episode: 335/1000, Reward: 481.500, Step: 200 | |
| 2023-04-17 14:24:33 - r - INFO: - Episode: 336/1000, Reward: 992.449, Step: 200 | |
| 2023-04-17 14:24:34 - r - INFO: - Episode: 337/1000, Reward: 716.702, Step: 200 | |
| 2023-04-17 14:24:34 - r - INFO: - Episode: 338/1000, Reward: 697.781, Step: 200 | |
| 2023-04-17 14:24:35 - r - INFO: - Episode: 339/1000, Reward: -34.708, Step: 200 | |
| 2023-04-17 14:24:36 - r - INFO: - Episode: 340/1000, Reward: 231.961, Step: 200 | |
| 2023-04-17 14:24:39 - r - INFO: - Episode: 341/1000, Reward: 798.434, Step: 200 | |
| 2023-04-17 14:24:40 - r - INFO: - Episode: 342/1000, Reward: 146.498, Step: 200 | |
| 2023-04-17 14:24:40 - r - INFO: - Episode: 343/1000, Reward: 1223.739, Step: 200 | |
| 2023-04-17 14:24:41 - r - INFO: - Episode: 344/1000, Reward: 326.800, Step: 200 | |
| 2023-04-17 14:24:41 - r - INFO: - Episode: 345/1000, Reward: 619.586, Step: 200 | |
| 2023-04-17 14:24:45 - r - INFO: - Episode: 346/1000, Reward: 681.383, Step: 200 | |
| 2023-04-17 14:24:46 - r - INFO: - Episode: 347/1000, Reward: 118.500, Step: 200 | |
| 2023-04-17 14:24:46 - r - INFO: - Episode: 348/1000, Reward: 281.490, Step: 200 | |
| 2023-04-17 14:24:47 - r - INFO: - Episode: 349/1000, Reward: 101.647, Step: 200 | |
| 2023-04-17 14:24:47 - r - INFO: - Episode: 350/1000, Reward: 1102.037, Step: 200 | |
| 2023-04-17 14:24:50 - r - INFO: - Current episode 350 has the best eval reward: 933.649 | |
| 2023-04-17 14:24:51 - r - INFO: - Episode: 351/1000, Reward: 470.470, Step: 200 | |
| 2023-04-17 14:24:51 - r - INFO: - Episode: 352/1000, Reward: 1139.708, Step: 200 | |
| 2023-04-17 14:24:52 - r - INFO: - Episode: 353/1000, Reward: 662.397, Step: 200 | |
| 2023-04-17 14:24:53 - r - INFO: - Episode: 354/1000, Reward: 704.077, Step: 200 | |
| 2023-04-17 14:24:53 - r - INFO: - Episode: 355/1000, Reward: 1056.759, Step: 200 | |
| 2023-04-17 14:24:57 - r - INFO: - Episode: 356/1000, Reward: 98.834, Step: 200 | |
| 2023-04-17 14:24:58 - r - INFO: - Episode: 357/1000, Reward: 465.316, Step: 200 | |
| 2023-04-17 14:24:58 - r - INFO: - Episode: 358/1000, Reward: 252.658, Step: 200 | |
| 2023-04-17 14:24:59 - r - INFO: - Episode: 359/1000, Reward: 907.869, Step: 200 | |
| 2023-04-17 14:25:00 - r - INFO: - Episode: 360/1000, Reward: 783.853, Step: 200 | |
| 2023-04-17 14:25:03 - r - INFO: - Episode: 361/1000, Reward: 1008.177, Step: 200 | |
| 2023-04-17 14:25:04 - r - INFO: - Episode: 362/1000, Reward: 550.195, Step: 200 | |
| 2023-04-17 14:25:05 - r - INFO: - Episode: 363/1000, Reward: 467.910, Step: 200 | |
| 2023-04-17 14:25:05 - r - INFO: - Episode: 364/1000, Reward: 80.382, Step: 200 | |
| 2023-04-17 14:25:06 - r - INFO: - Episode: 365/1000, Reward: 817.459, Step: 200 | |
| 2023-04-17 14:25:09 - r - INFO: - Episode: 366/1000, Reward: 760.718, Step: 200 | |
| 2023-04-17 14:25:10 - r - INFO: - Episode: 367/1000, Reward: 804.009, Step: 200 | |
| 2023-04-17 14:25:10 - r - INFO: - Episode: 368/1000, Reward: 1197.992, Step: 200 | |
| 2023-04-17 14:25:11 - r - INFO: - Episode: 369/1000, Reward: 730.026, Step: 200 | |
| 2023-04-17 14:25:12 - r - INFO: - Episode: 370/1000, Reward: 1089.508, Step: 200 | |
| 2023-04-17 14:25:15 - r - INFO: - Current episode 370 has the best eval reward: 953.187 | |
| 2023-04-17 14:25:15 - r - INFO: - Episode: 371/1000, Reward: 448.971, Step: 200 | |
| 2023-04-17 14:25:16 - r - INFO: - Episode: 372/1000, Reward: 788.668, Step: 200 | |
| 2023-04-17 14:25:16 - r - INFO: - Episode: 373/1000, Reward: 880.668, Step: 200 | |
| 2023-04-17 14:25:17 - r - INFO: - Episode: 374/1000, Reward: 1206.582, Step: 200 | |
| 2023-04-17 14:25:17 - r - INFO: - Episode: 375/1000, Reward: 460.745, Step: 200 | |
| 2023-04-17 14:25:21 - r - INFO: - Episode: 376/1000, Reward: 331.947, Step: 200 | |
| 2023-04-17 14:25:22 - r - INFO: - Episode: 377/1000, Reward: 683.261, Step: 200 | |
| 2023-04-17 14:25:22 - r - INFO: - Episode: 378/1000, Reward: 612.485, Step: 200 | |
| 2023-04-17 14:25:23 - r - INFO: - Episode: 379/1000, Reward: 1333.897, Step: 200 | |
| 2023-04-17 14:25:23 - r - INFO: - Episode: 380/1000, Reward: 1174.568, Step: 200 | |
| 2023-04-17 14:25:27 - r - INFO: - Episode: 381/1000, Reward: 216.481, Step: 200 | |
| 2023-04-17 14:25:28 - r - INFO: - Episode: 382/1000, Reward: 1095.802, Step: 200 | |
| 2023-04-17 14:25:28 - r - INFO: - Episode: 383/1000, Reward: 1235.750, Step: 200 | |
| 2023-04-17 14:25:29 - r - INFO: - Episode: 384/1000, Reward: 334.865, Step: 200 | |
| 2023-04-17 14:25:29 - r - INFO: - Episode: 385/1000, Reward: 467.626, Step: 200 | |
| 2023-04-17 14:25:33 - r - INFO: - Episode: 386/1000, Reward: 315.888, Step: 200 | |
| 2023-04-17 14:25:34 - r - INFO: - Episode: 387/1000, Reward: 116.421, Step: 200 | |
| 2023-04-17 14:25:35 - r - INFO: - Episode: 388/1000, Reward: 18.114, Step: 200 | |
| 2023-04-17 14:25:35 - r - INFO: - Episode: 389/1000, Reward: 1196.012, Step: 200 | |
| 2023-04-17 14:25:36 - r - INFO: - Episode: 390/1000, Reward: 1231.013, Step: 200 | |
| 2023-04-17 14:25:39 - r - INFO: - Episode: 391/1000, Reward: 770.481, Step: 200 | |
| 2023-04-17 14:25:40 - r - INFO: - Episode: 392/1000, Reward: 703.682, Step: 200 | |
| 2023-04-17 14:25:41 - r - INFO: - Episode: 393/1000, Reward: 1135.027, Step: 200 | |
| 2023-04-17 14:25:41 - r - INFO: - Episode: 394/1000, Reward: 158.624, Step: 200 | |
| 2023-04-17 14:25:42 - r - INFO: - Episode: 395/1000, Reward: 921.914, Step: 200 | |
| 2023-04-17 14:25:45 - r - INFO: - Current episode 395 has the best eval reward: 1012.412 | |
| 2023-04-17 14:25:46 - r - INFO: - Episode: 396/1000, Reward: 1255.950, Step: 200 | |
| 2023-04-17 14:25:46 - r - INFO: - Episode: 397/1000, Reward: 1134.413, Step: 200 | |
| 2023-04-17 14:25:47 - r - INFO: - Episode: 398/1000, Reward: 1040.113, Step: 200 | |
| 2023-04-17 14:25:47 - r - INFO: - Episode: 399/1000, Reward: 176.982, Step: 200 | |
| 2023-04-17 14:25:48 - r - INFO: - Episode: 400/1000, Reward: 152.716, Step: 200 | |
| 2023-04-17 14:25:52 - r - INFO: - Episode: 401/1000, Reward: 1274.312, Step: 200 | |
| 2023-04-17 14:25:53 - r - INFO: - Episode: 402/1000, Reward: 278.023, Step: 200 | |
| 2023-04-17 14:25:53 - r - INFO: - Episode: 403/1000, Reward: 1282.718, Step: 200 | |
| 2023-04-17 14:25:54 - r - INFO: - Episode: 404/1000, Reward: 1035.864, Step: 200 | |
| 2023-04-17 14:25:55 - r - INFO: - Episode: 405/1000, Reward: 1018.727, Step: 200 | |
| 2023-04-17 14:25:58 - r - INFO: - Episode: 406/1000, Reward: 691.938, Step: 200 | |
| 2023-04-17 14:25:59 - r - INFO: - Episode: 407/1000, Reward: 279.530, Step: 200 | |
| 2023-04-17 14:26:00 - r - INFO: - Episode: 408/1000, Reward: 749.076, Step: 200 | |
| 2023-04-17 14:26:00 - r - INFO: - Episode: 409/1000, Reward: 1310.240, Step: 200 | |
| 2023-04-17 14:26:01 - r - INFO: - Episode: 410/1000, Reward: 1023.312, Step: 200 | |
| 2023-04-17 14:26:05 - r - INFO: - Episode: 411/1000, Reward: 328.899, Step: 200 | |
| 2023-04-17 14:26:05 - r - INFO: - Episode: 412/1000, Reward: 1060.744, Step: 200 | |
| 2023-04-17 14:26:06 - r - INFO: - Episode: 413/1000, Reward: 536.737, Step: 200 | |
| 2023-04-17 14:26:06 - r - INFO: - Episode: 414/1000, Reward: 959.221, Step: 200 | |
| 2023-04-17 14:26:07 - r - INFO: - Episode: 415/1000, Reward: 1066.303, Step: 200 | |
| 2023-04-17 14:26:10 - r - INFO: - Episode: 416/1000, Reward: 1148.971, Step: 200 | |
| 2023-04-17 14:26:11 - r - INFO: - Episode: 417/1000, Reward: 1274.566, Step: 200 | |
| 2023-04-17 14:26:12 - r - INFO: - Episode: 418/1000, Reward: 1257.960, Step: 200 | |
| 2023-04-17 14:26:12 - r - INFO: - Episode: 419/1000, Reward: 984.619, Step: 200 | |
| 2023-04-17 14:26:13 - r - INFO: - Episode: 420/1000, Reward: 1159.036, Step: 200 | |
| 2023-04-17 14:26:16 - r - INFO: - Episode: 421/1000, Reward: 74.465, Step: 200 | |
| 2023-04-17 14:26:17 - r - INFO: - Episode: 422/1000, Reward: 10.670, Step: 200 | |
| 2023-04-17 14:26:18 - r - INFO: - Episode: 423/1000, Reward: 1274.714, Step: 200 | |
| 2023-04-17 14:26:18 - r - INFO: - Episode: 424/1000, Reward: 892.079, Step: 200 | |
| 2023-04-17 14:26:19 - r - INFO: - Episode: 425/1000, Reward: 698.716, Step: 200 | |
| 2023-04-17 14:26:22 - r - INFO: - Current episode 425 has the best eval reward: 1028.427 | |
| 2023-04-17 14:26:22 - r - INFO: - Episode: 426/1000, Reward: 1225.864, Step: 200 | |
| 2023-04-17 14:26:23 - r - INFO: - Episode: 427/1000, Reward: 72.346, Step: 200 | |
| 2023-04-17 14:26:24 - r - INFO: - Episode: 428/1000, Reward: 962.215, Step: 200 | |
| 2023-04-17 14:26:24 - r - INFO: - Episode: 429/1000, Reward: 14.879, Step: 200 | |
| 2023-04-17 14:26:25 - r - INFO: - Episode: 430/1000, Reward: 970.588, Step: 200 | |
| 2023-04-17 14:26:28 - r - INFO: - Episode: 431/1000, Reward: 1158.391, Step: 200 | |
| 2023-04-17 14:26:29 - r - INFO: - Episode: 432/1000, Reward: 568.867, Step: 200 | |
| 2023-04-17 14:26:30 - r - INFO: - Episode: 433/1000, Reward: 1334.252, Step: 200 | |
| 2023-04-17 14:26:30 - r - INFO: - Episode: 434/1000, Reward: 1251.842, Step: 200 | |
| 2023-04-17 14:26:31 - r - INFO: - Episode: 435/1000, Reward: 827.310, Step: 200 | |
| 2023-04-17 14:26:35 - r - INFO: - Episode: 436/1000, Reward: 657.988, Step: 200 | |
| 2023-04-17 14:26:35 - r - INFO: - Episode: 437/1000, Reward: 34.566, Step: 200 | |
| 2023-04-17 14:26:36 - r - INFO: - Episode: 438/1000, Reward: 1077.560, Step: 200 | |
| 2023-04-17 14:26:37 - r - INFO: - Episode: 439/1000, Reward: 35.438, Step: 200 | |
| 2023-04-17 14:26:37 - r - INFO: - Episode: 440/1000, Reward: 1220.925, Step: 200 | |
| 2023-04-17 14:26:41 - r - INFO: - Episode: 441/1000, Reward: 880.140, Step: 200 | |
| 2023-04-17 14:26:41 - r - INFO: - Episode: 442/1000, Reward: 1262.243, Step: 200 | |
| 2023-04-17 14:26:42 - r - INFO: - Episode: 443/1000, Reward: 375.213, Step: 200 | |
| 2023-04-17 14:26:43 - r - INFO: - Episode: 444/1000, Reward: 1335.946, Step: 200 | |
| 2023-04-17 14:26:43 - r - INFO: - Episode: 445/1000, Reward: -71.372, Step: 200 | |
| 2023-04-17 14:26:47 - r - INFO: - Episode: 446/1000, Reward: 1068.740, Step: 200 | |
| 2023-04-17 14:26:47 - r - INFO: - Episode: 447/1000, Reward: 225.259, Step: 200 | |
| 2023-04-17 14:26:48 - r - INFO: - Episode: 448/1000, Reward: 1033.825, Step: 200 | |
| 2023-04-17 14:26:49 - r - INFO: - Episode: 449/1000, Reward: 1154.308, Step: 200 | |
| 2023-04-17 14:26:49 - r - INFO: - Episode: 450/1000, Reward: 535.141, Step: 200 | |
| 2023-04-17 14:26:53 - r - INFO: - Current episode 450 has the best eval reward: 1102.113 | |
| 2023-04-17 14:26:53 - r - INFO: - Episode: 451/1000, Reward: 883.874, Step: 200 | |
| 2023-04-17 14:26:54 - r - INFO: - Episode: 452/1000, Reward: 1253.952, Step: 200 | |
| 2023-04-17 14:26:54 - r - INFO: - Episode: 453/1000, Reward: 949.978, Step: 200 | |
| 2023-04-17 14:26:55 - r - INFO: - Episode: 454/1000, Reward: 565.115, Step: 200 | |
| 2023-04-17 14:26:56 - r - INFO: - Episode: 455/1000, Reward: 1343.220, Step: 200 | |
| 2023-04-17 14:26:59 - r - INFO: - Episode: 456/1000, Reward: 1164.005, Step: 200 | |
| 2023-04-17 14:27:00 - r - INFO: - Episode: 457/1000, Reward: 1324.921, Step: 200 | |
| 2023-04-17 14:27:01 - r - INFO: - Episode: 458/1000, Reward: 539.195, Step: 200 | |
| 2023-04-17 14:27:01 - r - INFO: - Episode: 459/1000, Reward: 972.374, Step: 200 | |
| 2023-04-17 14:27:02 - r - INFO: - Episode: 460/1000, Reward: 1019.584, Step: 200 | |
| 2023-04-17 14:27:05 - r - INFO: - Episode: 461/1000, Reward: 1355.197, Step: 200 | |
| 2023-04-17 14:27:06 - r - INFO: - Episode: 462/1000, Reward: 68.088, Step: 200 | |
| 2023-04-17 14:27:06 - r - INFO: - Episode: 463/1000, Reward: 604.801, Step: 200 | |
| 2023-04-17 14:27:07 - r - INFO: - Episode: 464/1000, Reward: 1186.173, Step: 200 | |
| 2023-04-17 14:27:08 - r - INFO: - Episode: 465/1000, Reward: 945.381, Step: 200 | |
| 2023-04-17 14:27:11 - r - INFO: - Episode: 466/1000, Reward: 789.604, Step: 200 | |
| 2023-04-17 14:27:12 - r - INFO: - Episode: 467/1000, Reward: 1279.780, Step: 200 | |
| 2023-04-17 14:27:12 - r - INFO: - Episode: 468/1000, Reward: 293.803, Step: 200 | |
| 2023-04-17 14:27:13 - r - INFO: - Episode: 469/1000, Reward: 805.219, Step: 200 | |
| 2023-04-17 14:27:14 - r - INFO: - Episode: 470/1000, Reward: 909.764, Step: 200 | |
| 2023-04-17 14:27:17 - r - INFO: - Episode: 471/1000, Reward: 331.214, Step: 200 | |
| 2023-04-17 14:27:18 - r - INFO: - Episode: 472/1000, Reward: 1313.807, Step: 200 | |
| 2023-04-17 14:27:18 - r - INFO: - Episode: 473/1000, Reward: 1155.083, Step: 200 | |
| 2023-04-17 14:27:19 - r - INFO: - Episode: 474/1000, Reward: 700.048, Step: 200 | |
| 2023-04-17 14:27:20 - r - INFO: - Episode: 475/1000, Reward: 1053.117, Step: 200 | |
| 2023-04-17 14:27:23 - r - INFO: - Episode: 476/1000, Reward: 1165.505, Step: 200 | |
| 2023-04-17 14:27:24 - r - INFO: - Episode: 477/1000, Reward: 954.894, Step: 200 | |
| 2023-04-17 14:27:24 - r - INFO: - Episode: 478/1000, Reward: 1241.416, Step: 200 | |
| 2023-04-17 14:27:25 - r - INFO: - Episode: 479/1000, Reward: 1226.657, Step: 200 | |
| 2023-04-17 14:27:26 - r - INFO: - Episode: 480/1000, Reward: 729.777, Step: 200 | |
| 2023-04-17 14:27:29 - r - INFO: - Episode: 481/1000, Reward: 1331.551, Step: 200 | |
| 2023-04-17 14:27:30 - r - INFO: - Episode: 482/1000, Reward: 1302.924, Step: 200 | |
| 2023-04-17 14:27:31 - r - INFO: - Episode: 483/1000, Reward: 1152.677, Step: 200 | |
| 2023-04-17 14:27:31 - r - INFO: - Episode: 484/1000, Reward: 1249.512, Step: 200 | |
| 2023-04-17 14:27:32 - r - INFO: - Episode: 485/1000, Reward: 428.394, Step: 200 | |
| 2023-04-17 14:27:36 - r - INFO: - Episode: 486/1000, Reward: 551.072, Step: 200 | |
| 2023-04-17 14:27:36 - r - INFO: - Episode: 487/1000, Reward: 1259.426, Step: 200 | |
| 2023-04-17 14:27:37 - r - INFO: - Episode: 488/1000, Reward: 1153.321, Step: 200 | |
| 2023-04-17 14:27:37 - r - INFO: - Episode: 489/1000, Reward: 1277.736, Step: 200 | |
| 2023-04-17 14:27:38 - r - INFO: - Episode: 490/1000, Reward: 1311.365, Step: 200 | |
| 2023-04-17 14:27:42 - r - INFO: - Episode: 491/1000, Reward: 1243.443, Step: 200 | |
| 2023-04-17 14:27:42 - r - INFO: - Episode: 492/1000, Reward: 1055.171, Step: 200 | |
| 2023-04-17 14:27:43 - r - INFO: - Episode: 493/1000, Reward: 1069.428, Step: 200 | |
| 2023-04-17 14:27:43 - r - INFO: - Episode: 494/1000, Reward: 1142.228, Step: 200 | |
| 2023-04-17 14:27:44 - r - INFO: - Episode: 495/1000, Reward: 1299.908, Step: 200 | |
| 2023-04-17 14:27:48 - r - INFO: - Episode: 496/1000, Reward: 1330.430, Step: 200 | |
| 2023-04-17 14:27:48 - r - INFO: - Episode: 497/1000, Reward: 1190.936, Step: 200 | |
| 2023-04-17 14:27:49 - r - INFO: - Episode: 498/1000, Reward: 1311.508, Step: 200 | |
| 2023-04-17 14:27:49 - r - INFO: - Episode: 499/1000, Reward: 238.201, Step: 200 | |
| 2023-04-17 14:27:50 - r - INFO: - Episode: 500/1000, Reward: 1317.070, Step: 200 | |
| 2023-04-17 14:27:54 - r - INFO: - Episode: 501/1000, Reward: 948.480, Step: 200 | |
| 2023-04-17 14:27:54 - r - INFO: - Episode: 502/1000, Reward: 711.125, Step: 200 | |
| 2023-04-17 14:27:55 - r - INFO: - Episode: 503/1000, Reward: -27.825, Step: 200 | |
| 2023-04-17 14:27:55 - r - INFO: - Episode: 504/1000, Reward: 228.798, Step: 200 | |
| 2023-04-17 14:27:56 - r - INFO: - Episode: 505/1000, Reward: 78.605, Step: 200 | |
| 2023-04-17 14:27:59 - r - INFO: - Episode: 506/1000, Reward: 1207.067, Step: 200 | |
| 2023-04-17 14:28:00 - r - INFO: - Episode: 507/1000, Reward: 1279.422, Step: 200 | |
| 2023-04-17 14:28:01 - r - INFO: - Episode: 508/1000, Reward: 1251.832, Step: 200 | |
| 2023-04-17 14:28:01 - r - INFO: - Episode: 509/1000, Reward: 975.879, Step: 200 | |
| 2023-04-17 14:28:02 - r - INFO: - Episode: 510/1000, Reward: 1295.005, Step: 200 | |
| 2023-04-17 14:28:05 - r - INFO: - Episode: 511/1000, Reward: 1140.732, Step: 200 | |
| 2023-04-17 14:28:06 - r - INFO: - Episode: 512/1000, Reward: 328.784, Step: 200 | |
| 2023-04-17 14:28:06 - r - INFO: - Episode: 513/1000, Reward: 1193.562, Step: 200 | |
| 2023-04-17 14:28:07 - r - INFO: - Episode: 514/1000, Reward: 537.291, Step: 200 | |
| 2023-04-17 14:28:08 - r - INFO: - Episode: 515/1000, Reward: 1206.355, Step: 200 | |
| 2023-04-17 14:28:11 - r - INFO: - Episode: 516/1000, Reward: 1303.571, Step: 200 | |
| 2023-04-17 14:28:12 - r - INFO: - Episode: 517/1000, Reward: 1323.482, Step: 200 | |
| 2023-04-17 14:28:12 - r - INFO: - Episode: 518/1000, Reward: 1242.277, Step: 200 | |
| 2023-04-17 14:28:13 - r - INFO: - Episode: 519/1000, Reward: 1068.176, Step: 200 | |
| 2023-04-17 14:28:14 - r - INFO: - Episode: 520/1000, Reward: 1293.309, Step: 200 | |
| 2023-04-17 14:28:17 - r - INFO: - Current episode 520 has the best eval reward: 1116.827 | |
| 2023-04-17 14:28:17 - r - INFO: - Episode: 521/1000, Reward: 1286.080, Step: 200 | |
| 2023-04-17 14:28:18 - r - INFO: - Episode: 522/1000, Reward: 1195.859, Step: 200 | |
| 2023-04-17 14:28:18 - r - INFO: - Episode: 523/1000, Reward: 1193.774, Step: 200 | |
| 2023-04-17 14:28:19 - r - INFO: - Episode: 524/1000, Reward: 360.607, Step: 200 | |
| 2023-04-17 14:28:20 - r - INFO: - Episode: 525/1000, Reward: 1191.235, Step: 200 | |
| 2023-04-17 14:28:23 - r - INFO: - Episode: 526/1000, Reward: 893.780, Step: 200 | |
| 2023-04-17 14:28:24 - r - INFO: - Episode: 527/1000, Reward: 1171.348, Step: 200 | |
| 2023-04-17 14:28:24 - r - INFO: - Episode: 528/1000, Reward: 995.855, Step: 200 | |
| 2023-04-17 14:28:25 - r - INFO: - Episode: 529/1000, Reward: 52.957, Step: 200 | |
| 2023-04-17 14:28:25 - r - INFO: - Episode: 530/1000, Reward: 1352.290, Step: 200 | |
| 2023-04-17 14:28:29 - r - INFO: - Episode: 531/1000, Reward: 1140.687, Step: 200 | |
| 2023-04-17 14:28:30 - r - INFO: - Episode: 532/1000, Reward: 1299.395, Step: 200 | |
| 2023-04-17 14:28:30 - r - INFO: - Episode: 533/1000, Reward: 809.787, Step: 200 | |
| 2023-04-17 14:28:31 - r - INFO: - Episode: 534/1000, Reward: 1198.862, Step: 200 | |
| 2023-04-17 14:28:31 - r - INFO: - Episode: 535/1000, Reward: 1112.083, Step: 200 | |
| 2023-04-17 14:28:35 - r - INFO: - Episode: 536/1000, Reward: 27.220, Step: 200 | |
| 2023-04-17 14:28:36 - r - INFO: - Episode: 537/1000, Reward: 923.530, Step: 200 | |
| 2023-04-17 14:28:36 - r - INFO: - Episode: 538/1000, Reward: 1116.382, Step: 200 | |
| 2023-04-17 14:28:37 - r - INFO: - Episode: 539/1000, Reward: 1089.475, Step: 200 | |
| 2023-04-17 14:28:37 - r - INFO: - Episode: 540/1000, Reward: 1401.341, Step: 200 | |
| 2023-04-17 14:28:41 - r - INFO: - Episode: 541/1000, Reward: 1138.145, Step: 200 | |
| 2023-04-17 14:28:41 - r - INFO: - Episode: 542/1000, Reward: 851.590, Step: 200 | |
| 2023-04-17 14:28:42 - r - INFO: - Episode: 543/1000, Reward: 288.912, Step: 200 | |
| 2023-04-17 14:28:43 - r - INFO: - Episode: 544/1000, Reward: 1086.558, Step: 200 | |
| 2023-04-17 14:28:43 - r - INFO: - Episode: 545/1000, Reward: 1005.923, Step: 200 | |
| 2023-04-17 14:28:47 - r - INFO: - Episode: 546/1000, Reward: 1130.195, Step: 200 | |
| 2023-04-17 14:28:47 - r - INFO: - Episode: 547/1000, Reward: 1265.428, Step: 200 | |
| 2023-04-17 14:28:48 - r - INFO: - Episode: 548/1000, Reward: 66.692, Step: 200 | |
| 2023-04-17 14:28:48 - r - INFO: - Episode: 549/1000, Reward: 1311.940, Step: 200 | |
| 2023-04-17 14:28:49 - r - INFO: - Episode: 550/1000, Reward: 946.601, Step: 200 | |
| 2023-04-17 14:28:52 - r - INFO: - Current episode 550 has the best eval reward: 1120.160 | |
| 2023-04-17 14:28:53 - r - INFO: - Episode: 551/1000, Reward: 1162.878, Step: 200 | |
| 2023-04-17 14:28:54 - r - INFO: - Episode: 552/1000, Reward: 1257.157, Step: 200 | |
| 2023-04-17 14:28:54 - r - INFO: - Episode: 553/1000, Reward: 1015.252, Step: 200 | |
| 2023-04-17 14:28:55 - r - INFO: - Episode: 554/1000, Reward: 1312.464, Step: 200 | |
| 2023-04-17 14:28:55 - r - INFO: - Episode: 555/1000, Reward: 1345.138, Step: 200 | |
| 2023-04-17 14:28:58 - r - INFO: - Current episode 555 has the best eval reward: 1237.822 | |
| 2023-04-17 14:28:59 - r - INFO: - Episode: 556/1000, Reward: 1231.974, Step: 200 | |
| 2023-04-17 14:29:00 - r - INFO: - Episode: 557/1000, Reward: 1315.708, Step: 200 | |
| 2023-04-17 14:29:00 - r - INFO: - Episode: 558/1000, Reward: 900.950, Step: 200 | |
| 2023-04-17 14:29:01 - r - INFO: - Episode: 559/1000, Reward: 1122.070, Step: 200 | |
| 2023-04-17 14:29:02 - r - INFO: - Episode: 560/1000, Reward: 585.558, Step: 200 | |
| 2023-04-17 14:29:05 - r - INFO: - Episode: 561/1000, Reward: 1220.437, Step: 200 | |
| 2023-04-17 14:29:06 - r - INFO: - Episode: 562/1000, Reward: 1190.981, Step: 200 | |
| 2023-04-17 14:29:07 - r - INFO: - Episode: 563/1000, Reward: 178.020, Step: 200 | |
| 2023-04-17 14:29:07 - r - INFO: - Episode: 564/1000, Reward: 1312.676, Step: 200 | |
| 2023-04-17 14:29:08 - r - INFO: - Episode: 565/1000, Reward: 1294.659, Step: 200 | |
| 2023-04-17 14:29:11 - r - INFO: - Current episode 565 has the best eval reward: 1267.254 | |
| 2023-04-17 14:29:12 - r - INFO: - Episode: 566/1000, Reward: 1331.174, Step: 200 | |
| 2023-04-17 14:29:12 - r - INFO: - Episode: 567/1000, Reward: 1261.742, Step: 200 | |
| 2023-04-17 14:29:13 - r - INFO: - Episode: 568/1000, Reward: 1201.538, Step: 200 | |
| 2023-04-17 14:29:14 - r - INFO: - Episode: 569/1000, Reward: 1196.742, Step: 200 | |
| 2023-04-17 14:29:14 - r - INFO: - Episode: 570/1000, Reward: 1263.599, Step: 200 | |
| 2023-04-17 14:29:18 - r - INFO: - Episode: 571/1000, Reward: 1081.410, Step: 200 | |
| 2023-04-17 14:29:18 - r - INFO: - Episode: 572/1000, Reward: 1227.263, Step: 200 | |
| 2023-04-17 14:29:19 - r - INFO: - Episode: 573/1000, Reward: 1089.583, Step: 200 | |
| 2023-04-17 14:29:20 - r - INFO: - Episode: 574/1000, Reward: 1280.784, Step: 200 | |
| 2023-04-17 14:29:20 - r - INFO: - Episode: 575/1000, Reward: 1328.005, Step: 200 | |
| 2023-04-17 14:29:24 - r - INFO: - Episode: 576/1000, Reward: 776.235, Step: 200 | |
| 2023-04-17 14:29:24 - r - INFO: - Episode: 577/1000, Reward: 1063.882, Step: 200 | |
| 2023-04-17 14:29:25 - r - INFO: - Episode: 578/1000, Reward: 863.966, Step: 200 | |
| 2023-04-17 14:29:25 - r - INFO: - Episode: 579/1000, Reward: 1268.379, Step: 200 | |
| 2023-04-17 14:29:26 - r - INFO: - Episode: 580/1000, Reward: 1329.069, Step: 200 | |
| 2023-04-17 14:29:30 - r - INFO: - Episode: 581/1000, Reward: 1224.770, Step: 200 | |
| 2023-04-17 14:29:30 - r - INFO: - Episode: 582/1000, Reward: 1161.005, Step: 200 | |
| 2023-04-17 14:29:31 - r - INFO: - Episode: 583/1000, Reward: 1161.707, Step: 200 | |
| 2023-04-17 14:29:31 - r - INFO: - Episode: 584/1000, Reward: 1255.891, Step: 200 | |
| 2023-04-17 14:29:32 - r - INFO: - Episode: 585/1000, Reward: 1070.103, Step: 200 | |
| 2023-04-17 14:29:35 - r - INFO: - Episode: 586/1000, Reward: 1024.018, Step: 200 | |
| 2023-04-17 14:29:36 - r - INFO: - Episode: 587/1000, Reward: 1227.930, Step: 200 | |
| 2023-04-17 14:29:36 - r - INFO: - Episode: 588/1000, Reward: 997.664, Step: 200 | |
| 2023-04-17 14:29:37 - r - INFO: - Episode: 589/1000, Reward: 1068.597, Step: 200 | |
| 2023-04-17 14:29:38 - r - INFO: - Episode: 590/1000, Reward: 1232.995, Step: 200 | |
| 2023-04-17 14:29:41 - r - INFO: - Current episode 590 has the best eval reward: 1281.434 | |
| 2023-04-17 14:29:41 - r - INFO: - Episode: 591/1000, Reward: 1132.430, Step: 200 | |
| 2023-04-17 14:29:42 - r - INFO: - Episode: 592/1000, Reward: 1351.904, Step: 200 | |
| 2023-04-17 14:29:42 - r - INFO: - Episode: 593/1000, Reward: 1216.381, Step: 200 | |
| 2023-04-17 14:29:43 - r - INFO: - Episode: 594/1000, Reward: 1087.879, Step: 200 | |
| 2023-04-17 14:29:44 - r - INFO: - Episode: 595/1000, Reward: 630.317, Step: 200 | |
| 2023-04-17 14:29:47 - r - INFO: - Episode: 596/1000, Reward: 990.984, Step: 200 | |
| 2023-04-17 14:29:48 - r - INFO: - Episode: 597/1000, Reward: 1309.481, Step: 200 | |
| 2023-04-17 14:29:48 - r - INFO: - Episode: 598/1000, Reward: 1180.740, Step: 200 | |
| 2023-04-17 14:29:49 - r - INFO: - Episode: 599/1000, Reward: 1301.051, Step: 200 | |
| 2023-04-17 14:29:49 - r - INFO: - Episode: 600/1000, Reward: 1221.446, Step: 200 | |
| 2023-04-17 14:29:53 - r - INFO: - Episode: 601/1000, Reward: 1274.307, Step: 200 | |
| 2023-04-17 14:29:53 - r - INFO: - Episode: 602/1000, Reward: 1101.141, Step: 200 | |
| 2023-04-17 14:29:54 - r - INFO: - Episode: 603/1000, Reward: 1287.806, Step: 200 | |
| 2023-04-17 14:29:54 - r - INFO: - Episode: 604/1000, Reward: 736.060, Step: 200 | |
| 2023-04-17 14:29:55 - r - INFO: - Episode: 605/1000, Reward: 780.333, Step: 200 | |
| 2023-04-17 14:29:58 - r - INFO: - Episode: 606/1000, Reward: 1232.103, Step: 200 | |
| 2023-04-17 14:29:59 - r - INFO: - Episode: 607/1000, Reward: 1196.191, Step: 200 | |
| 2023-04-17 14:30:00 - r - INFO: - Episode: 608/1000, Reward: 1256.484, Step: 200 | |
| 2023-04-17 14:30:00 - r - INFO: - Episode: 609/1000, Reward: 1275.764, Step: 200 | |
| 2023-04-17 14:30:01 - r - INFO: - Episode: 610/1000, Reward: 1255.036, Step: 200 | |
| 2023-04-17 14:30:04 - r - INFO: - Episode: 611/1000, Reward: 1205.183, Step: 200 | |
| 2023-04-17 14:30:05 - r - INFO: - Episode: 612/1000, Reward: 1290.039, Step: 200 | |
| 2023-04-17 14:30:06 - r - INFO: - Episode: 613/1000, Reward: 1093.536, Step: 200 | |
| 2023-04-17 14:30:06 - r - INFO: - Episode: 614/1000, Reward: 1235.028, Step: 200 | |
| 2023-04-17 14:30:07 - r - INFO: - Episode: 615/1000, Reward: 1323.850, Step: 200 | |
| 2023-04-17 14:30:10 - r - INFO: - Current episode 615 has the best eval reward: 1290.598 | |
| 2023-04-17 14:30:10 - r - INFO: - Episode: 616/1000, Reward: 1154.888, Step: 200 | |
| 2023-04-17 14:30:11 - r - INFO: - Episode: 617/1000, Reward: 1149.666, Step: 200 | |
| 2023-04-17 14:30:11 - r - INFO: - Episode: 618/1000, Reward: 1264.052, Step: 200 | |
| 2023-04-17 14:30:12 - r - INFO: - Episode: 619/1000, Reward: 1195.736, Step: 200 | |
| 2023-04-17 14:30:12 - r - INFO: - Episode: 620/1000, Reward: 1310.498, Step: 200 | |
| 2023-04-17 14:30:16 - r - INFO: - Episode: 621/1000, Reward: 1303.922, Step: 200 | |
| 2023-04-17 14:30:16 - r - INFO: - Episode: 622/1000, Reward: 1374.958, Step: 200 | |
| 2023-04-17 14:30:17 - r - INFO: - Episode: 623/1000, Reward: 93.046, Step: 200 | |
| 2023-04-17 14:30:18 - r - INFO: - Episode: 624/1000, Reward: 1265.441, Step: 200 | |
| 2023-04-17 14:30:18 - r - INFO: - Episode: 625/1000, Reward: 1199.816, Step: 200 | |
| 2023-04-17 14:30:22 - r - INFO: - Episode: 626/1000, Reward: 1136.972, Step: 200 | |
| 2023-04-17 14:30:22 - r - INFO: - Episode: 627/1000, Reward: 1249.220, Step: 200 | |
| 2023-04-17 14:30:23 - r - INFO: - Episode: 628/1000, Reward: 1274.604, Step: 200 | |
| 2023-04-17 14:30:23 - r - INFO: - Episode: 629/1000, Reward: 1135.944, Step: 200 | |
| 2023-04-17 14:30:24 - r - INFO: - Episode: 630/1000, Reward: 1068.062, Step: 200 | |
| 2023-04-17 14:30:28 - r - INFO: - Episode: 631/1000, Reward: 1184.754, Step: 200 | |
| 2023-04-17 14:30:29 - r - INFO: - Episode: 632/1000, Reward: 1286.905, Step: 200 | |
| 2023-04-17 14:30:29 - r - INFO: - Episode: 633/1000, Reward: 669.256, Step: 200 | |
| 2023-04-17 14:30:30 - r - INFO: - Episode: 634/1000, Reward: 1307.452, Step: 200 | |
| 2023-04-17 14:30:30 - r - INFO: - Episode: 635/1000, Reward: 1335.907, Step: 200 | |
| 2023-04-17 14:30:34 - r - INFO: - Episode: 636/1000, Reward: 1331.636, Step: 200 | |
| 2023-04-17 14:30:34 - r - INFO: - Episode: 637/1000, Reward: 1188.516, Step: 200 | |
| 2023-04-17 14:30:35 - r - INFO: - Episode: 638/1000, Reward: 1245.262, Step: 200 | |
| 2023-04-17 14:30:36 - r - INFO: - Episode: 639/1000, Reward: 1348.340, Step: 200 | |
| 2023-04-17 14:30:36 - r - INFO: - Episode: 640/1000, Reward: 857.471, Step: 200 | |
| 2023-04-17 14:30:40 - r - INFO: - Episode: 641/1000, Reward: 1209.847, Step: 200 | |
| 2023-04-17 14:30:40 - r - INFO: - Episode: 642/1000, Reward: 1240.901, Step: 200 | |
| 2023-04-17 14:30:41 - r - INFO: - Episode: 643/1000, Reward: 1109.122, Step: 200 | |
| 2023-04-17 14:30:41 - r - INFO: - Episode: 644/1000, Reward: 963.117, Step: 200 | |
| 2023-04-17 14:30:42 - r - INFO: - Episode: 645/1000, Reward: 1274.807, Step: 200 | |
| 2023-04-17 14:30:45 - r - INFO: - Episode: 646/1000, Reward: 1050.752, Step: 200 | |
| 2023-04-17 14:30:46 - r - INFO: - Episode: 647/1000, Reward: 1394.579, Step: 200 | |
| 2023-04-17 14:30:46 - r - INFO: - Episode: 648/1000, Reward: 260.696, Step: 200 | |
| 2023-04-17 14:30:47 - r - INFO: - Episode: 649/1000, Reward: 1221.685, Step: 200 | |
| 2023-04-17 14:30:47 - r - INFO: - Episode: 650/1000, Reward: 1349.005, Step: 200 | |
| 2023-04-17 14:30:50 - r - INFO: - Episode: 651/1000, Reward: 1148.666, Step: 200 | |
| 2023-04-17 14:30:51 - r - INFO: - Episode: 652/1000, Reward: 1307.231, Step: 200 | |
| 2023-04-17 14:30:52 - r - INFO: - Episode: 653/1000, Reward: 1217.638, Step: 200 | |
| 2023-04-17 14:30:52 - r - INFO: - Episode: 654/1000, Reward: 1298.523, Step: 200 | |
| 2023-04-17 14:30:53 - r - INFO: - Episode: 655/1000, Reward: 973.733, Step: 200 | |
| 2023-04-17 14:30:56 - r - INFO: - Episode: 656/1000, Reward: 1313.456, Step: 200 | |
| 2023-04-17 14:30:56 - r - INFO: - Episode: 657/1000, Reward: 1319.007, Step: 200 | |
| 2023-04-17 14:30:57 - r - INFO: - Episode: 658/1000, Reward: 1189.774, Step: 200 | |
| 2023-04-17 14:30:57 - r - INFO: - Episode: 659/1000, Reward: 1284.631, Step: 200 | |
| 2023-04-17 14:30:58 - r - INFO: - Episode: 660/1000, Reward: 1194.366, Step: 200 | |
| 2023-04-17 14:31:01 - r - INFO: - Episode: 661/1000, Reward: 1351.083, Step: 200 | |
| 2023-04-17 14:31:01 - r - INFO: - Episode: 662/1000, Reward: 1124.721, Step: 200 | |
| 2023-04-17 14:31:02 - r - INFO: - Episode: 663/1000, Reward: 1281.672, Step: 200 | |
| 2023-04-17 14:31:02 - r - INFO: - Episode: 664/1000, Reward: 17.134, Step: 200 | |
| 2023-04-17 14:31:03 - r - INFO: - Episode: 665/1000, Reward: 1307.462, Step: 200 | |
| 2023-04-17 14:31:06 - r - INFO: - Episode: 666/1000, Reward: 1270.906, Step: 200 | |
| 2023-04-17 14:31:06 - r - INFO: - Episode: 667/1000, Reward: 592.865, Step: 200 | |
| 2023-04-17 14:31:07 - r - INFO: - Episode: 668/1000, Reward: 1371.337, Step: 200 | |
| 2023-04-17 14:31:08 - r - INFO: - Episode: 669/1000, Reward: 1283.597, Step: 200 | |
| 2023-04-17 14:31:08 - r - INFO: - Episode: 670/1000, Reward: 1230.348, Step: 200 | |
| 2023-04-17 14:31:11 - r - INFO: - Episode: 671/1000, Reward: -14.820, Step: 200 | |
| 2023-04-17 14:31:12 - r - INFO: - Episode: 672/1000, Reward: 944.524, Step: 200 | |
| 2023-04-17 14:31:13 - r - INFO: - Episode: 673/1000, Reward: 955.326, Step: 200 | |
| 2023-04-17 14:31:13 - r - INFO: - Episode: 674/1000, Reward: 1201.171, Step: 200 | |
| 2023-04-17 14:31:14 - r - INFO: - Episode: 675/1000, Reward: 1182.224, Step: 200 | |
| 2023-04-17 14:31:17 - r - INFO: - Episode: 676/1000, Reward: 1288.239, Step: 200 | |
| 2023-04-17 14:31:18 - r - INFO: - Episode: 677/1000, Reward: 826.745, Step: 200 | |
| 2023-04-17 14:31:18 - r - INFO: - Episode: 678/1000, Reward: 1295.044, Step: 200 | |
| 2023-04-17 14:31:19 - r - INFO: - Episode: 679/1000, Reward: 867.348, Step: 200 | |
| 2023-04-17 14:31:19 - r - INFO: - Episode: 680/1000, Reward: 662.400, Step: 200 | |
| 2023-04-17 14:31:23 - r - INFO: - Episode: 681/1000, Reward: 1303.082, Step: 200 | |
| 2023-04-17 14:31:24 - r - INFO: - Episode: 682/1000, Reward: 492.349, Step: 200 | |
| 2023-04-17 14:31:24 - r - INFO: - Episode: 683/1000, Reward: 1276.593, Step: 200 | |
| 2023-04-17 14:31:25 - r - INFO: - Episode: 684/1000, Reward: 1084.811, Step: 200 | |
| 2023-04-17 14:31:26 - r - INFO: - Episode: 685/1000, Reward: 1373.639, Step: 200 | |
| 2023-04-17 14:31:29 - r - INFO: - Current episode 685 has the best eval reward: 1296.914 | |
| 2023-04-17 14:31:29 - r - INFO: - Episode: 686/1000, Reward: 1326.463, Step: 200 | |
| 2023-04-17 14:31:30 - r - INFO: - Episode: 687/1000, Reward: 1260.727, Step: 200 | |
| 2023-04-17 14:31:31 - r - INFO: - Episode: 688/1000, Reward: 1163.930, Step: 200 | |
| 2023-04-17 14:31:31 - r - INFO: - Episode: 689/1000, Reward: 1310.915, Step: 200 | |
| 2023-04-17 14:31:32 - r - INFO: - Episode: 690/1000, Reward: 1346.887, Step: 200 | |
| 2023-04-17 14:31:35 - r - INFO: - Episode: 691/1000, Reward: 1331.971, Step: 200 | |
| 2023-04-17 14:31:36 - r - INFO: - Episode: 692/1000, Reward: 1355.312, Step: 200 | |
| 2023-04-17 14:31:36 - r - INFO: - Episode: 693/1000, Reward: 216.866, Step: 200 | |
| 2023-04-17 14:31:37 - r - INFO: - Episode: 694/1000, Reward: 1220.595, Step: 200 | |
| 2023-04-17 14:31:37 - r - INFO: - Episode: 695/1000, Reward: 1257.603, Step: 200 | |
| 2023-04-17 14:31:41 - r - INFO: - Episode: 696/1000, Reward: 1279.505, Step: 200 | |
| 2023-04-17 14:31:42 - r - INFO: - Episode: 697/1000, Reward: 1243.701, Step: 200 | |
| 2023-04-17 14:31:42 - r - INFO: - Episode: 698/1000, Reward: 1301.858, Step: 200 | |
| 2023-04-17 14:31:43 - r - INFO: - Episode: 699/1000, Reward: 1319.853, Step: 200 | |
| 2023-04-17 14:31:43 - r - INFO: - Episode: 700/1000, Reward: 1315.377, Step: 200 | |
| 2023-04-17 14:31:47 - r - INFO: - Episode: 701/1000, Reward: 1343.651, Step: 200 | |
| 2023-04-17 14:31:47 - r - INFO: - Episode: 702/1000, Reward: 1298.581, Step: 200 | |
| 2023-04-17 14:31:48 - r - INFO: - Episode: 703/1000, Reward: 1390.105, Step: 200 | |
| 2023-04-17 14:31:48 - r - INFO: - Episode: 704/1000, Reward: 1081.106, Step: 200 | |
| 2023-04-17 14:31:49 - r - INFO: - Episode: 705/1000, Reward: 1274.281, Step: 200 | |
| 2023-04-17 14:31:52 - r - INFO: - Episode: 706/1000, Reward: 1301.908, Step: 200 | |
| 2023-04-17 14:31:53 - r - INFO: - Episode: 707/1000, Reward: 818.885, Step: 200 | |
| 2023-04-17 14:31:53 - r - INFO: - Episode: 708/1000, Reward: 1267.789, Step: 200 | |
| 2023-04-17 14:31:54 - r - INFO: - Episode: 709/1000, Reward: 1195.448, Step: 200 | |
| 2023-04-17 14:31:54 - r - INFO: - Episode: 710/1000, Reward: 1272.118, Step: 200 | |
| 2023-04-17 14:31:58 - r - INFO: - Episode: 711/1000, Reward: 1347.728, Step: 200 | |
| 2023-04-17 14:31:58 - r - INFO: - Episode: 712/1000, Reward: 1348.907, Step: 200 | |
| 2023-04-17 14:31:59 - r - INFO: - Episode: 713/1000, Reward: 1222.896, Step: 200 | |
| 2023-04-17 14:32:00 - r - INFO: - Episode: 714/1000, Reward: 1044.141, Step: 200 | |
| 2023-04-17 14:32:00 - r - INFO: - Episode: 715/1000, Reward: 1011.024, Step: 200 | |
| 2023-04-17 14:32:04 - r - INFO: - Episode: 716/1000, Reward: 1400.958, Step: 200 | |
| 2023-04-17 14:32:04 - r - INFO: - Episode: 717/1000, Reward: 1422.429, Step: 200 | |
| 2023-04-17 14:32:05 - r - INFO: - Episode: 718/1000, Reward: 1307.193, Step: 200 | |
| 2023-04-17 14:32:05 - r - INFO: - Episode: 719/1000, Reward: 1215.926, Step: 200 | |
| 2023-04-17 14:32:06 - r - INFO: - Episode: 720/1000, Reward: 571.403, Step: 200 | |
| 2023-04-17 14:32:09 - r - INFO: - Episode: 721/1000, Reward: 1188.454, Step: 200 | |
| 2023-04-17 14:32:10 - r - INFO: - Episode: 722/1000, Reward: 1255.989, Step: 200 | |
| 2023-04-17 14:32:11 - r - INFO: - Episode: 723/1000, Reward: 1302.865, Step: 200 | |
| 2023-04-17 14:32:11 - r - INFO: - Episode: 724/1000, Reward: 1368.529, Step: 200 | |
| 2023-04-17 14:32:12 - r - INFO: - Episode: 725/1000, Reward: 1344.853, Step: 200 | |
| 2023-04-17 14:32:15 - r - INFO: - Current episode 725 has the best eval reward: 1326.194 | |
| 2023-04-17 14:32:15 - r - INFO: - Episode: 726/1000, Reward: 1148.115, Step: 200 | |
| 2023-04-17 14:32:16 - r - INFO: - Episode: 727/1000, Reward: 1325.442, Step: 200 | |
| 2023-04-17 14:32:17 - r - INFO: - Episode: 728/1000, Reward: 904.671, Step: 200 | |
| 2023-04-17 14:32:17 - r - INFO: - Episode: 729/1000, Reward: 1289.060, Step: 200 | |
| 2023-04-17 14:32:18 - r - INFO: - Episode: 730/1000, Reward: 1253.961, Step: 200 | |
| 2023-04-17 14:32:22 - r - INFO: - Episode: 731/1000, Reward: 1263.881, Step: 200 | |
| 2023-04-17 14:32:22 - r - INFO: - Episode: 732/1000, Reward: 1308.113, Step: 200 | |
| 2023-04-17 14:32:23 - r - INFO: - Episode: 733/1000, Reward: 1282.323, Step: 200 | |
| 2023-04-17 14:32:23 - r - INFO: - Episode: 734/1000, Reward: 1333.625, Step: 200 | |
| 2023-04-17 14:32:24 - r - INFO: - Episode: 735/1000, Reward: 1295.069, Step: 200 | |
| 2023-04-17 14:32:27 - r - INFO: - Episode: 736/1000, Reward: 1246.314, Step: 200 | |
| 2023-04-17 14:32:28 - r - INFO: - Episode: 737/1000, Reward: 434.225, Step: 200 | |
| 2023-04-17 14:32:29 - r - INFO: - Episode: 738/1000, Reward: 1162.501, Step: 200 | |
| 2023-04-17 14:32:29 - r - INFO: - Episode: 739/1000, Reward: 1035.620, Step: 200 | |
| 2023-04-17 14:32:30 - r - INFO: - Episode: 740/1000, Reward: 205.288, Step: 200 | |
| 2023-04-17 14:32:33 - r - INFO: - Episode: 741/1000, Reward: 1264.967, Step: 200 | |
| 2023-04-17 14:32:33 - r - INFO: - Episode: 742/1000, Reward: 317.111, Step: 200 | |
| 2023-04-17 14:32:34 - r - INFO: - Episode: 743/1000, Reward: 1137.949, Step: 200 | |
| 2023-04-17 14:32:35 - r - INFO: - Episode: 744/1000, Reward: 1264.100, Step: 200 | |
| 2023-04-17 14:32:35 - r - INFO: - Episode: 745/1000, Reward: 1307.818, Step: 200 | |
| 2023-04-17 14:32:39 - r - INFO: - Episode: 746/1000, Reward: 1325.603, Step: 200 | |
| 2023-04-17 14:32:39 - r - INFO: - Episode: 747/1000, Reward: 1237.911, Step: 200 | |
| 2023-04-17 14:32:40 - r - INFO: - Episode: 748/1000, Reward: 769.344, Step: 200 | |
| 2023-04-17 14:32:40 - r - INFO: - Episode: 749/1000, Reward: 917.954, Step: 200 | |
| 2023-04-17 14:32:41 - r - INFO: - Episode: 750/1000, Reward: 1391.419, Step: 200 | |
| 2023-04-17 14:32:44 - r - INFO: - Episode: 751/1000, Reward: 1225.399, Step: 200 | |
| 2023-04-17 14:32:45 - r - INFO: - Episode: 752/1000, Reward: 1223.488, Step: 200 | |
| 2023-04-17 14:32:45 - r - INFO: - Episode: 753/1000, Reward: 1308.513, Step: 200 | |
| 2023-04-17 14:32:46 - r - INFO: - Episode: 754/1000, Reward: 1182.427, Step: 200 | |
| 2023-04-17 14:32:47 - r - INFO: - Episode: 755/1000, Reward: 1205.518, Step: 200 | |
| 2023-04-17 14:32:50 - r - INFO: - Episode: 756/1000, Reward: 1134.959, Step: 200 | |
| 2023-04-17 14:32:50 - r - INFO: - Episode: 757/1000, Reward: 1205.077, Step: 200 | |
| 2023-04-17 14:32:51 - r - INFO: - Episode: 758/1000, Reward: 28.444, Step: 200 | |
| 2023-04-17 14:32:52 - r - INFO: - Episode: 759/1000, Reward: 1170.101, Step: 200 | |
| 2023-04-17 14:32:52 - r - INFO: - Episode: 760/1000, Reward: 1073.834, Step: 200 | |
| 2023-04-17 14:32:56 - r - INFO: - Episode: 761/1000, Reward: 1209.624, Step: 200 | |
| 2023-04-17 14:32:56 - r - INFO: - Episode: 762/1000, Reward: 1332.656, Step: 200 | |
| 2023-04-17 14:32:57 - r - INFO: - Episode: 763/1000, Reward: 1324.009, Step: 200 | |
| 2023-04-17 14:32:57 - r - INFO: - Episode: 764/1000, Reward: 1300.299, Step: 200 | |
| 2023-04-17 14:32:58 - r - INFO: - Episode: 765/1000, Reward: 1471.591, Step: 200 | |
| 2023-04-17 14:33:01 - r - INFO: - Episode: 766/1000, Reward: 1102.395, Step: 200 | |
| 2023-04-17 14:33:02 - r - INFO: - Episode: 767/1000, Reward: 303.052, Step: 200 | |
| 2023-04-17 14:33:02 - r - INFO: - Episode: 768/1000, Reward: 1308.734, Step: 200 | |
| 2023-04-17 14:33:03 - r - INFO: - Episode: 769/1000, Reward: 1309.907, Step: 200 | |
| 2023-04-17 14:33:04 - r - INFO: - Episode: 770/1000, Reward: 1144.994, Step: 200 | |
| 2023-04-17 14:33:07 - r - INFO: - Episode: 771/1000, Reward: 1313.509, Step: 200 | |
| 2023-04-17 14:33:08 - r - INFO: - Episode: 772/1000, Reward: 1193.621, Step: 200 | |
| 2023-04-17 14:33:08 - r - INFO: - Episode: 773/1000, Reward: 1213.907, Step: 200 | |
| 2023-04-17 14:33:09 - r - INFO: - Episode: 774/1000, Reward: 1315.015, Step: 200 | |
| 2023-04-17 14:33:09 - r - INFO: - Episode: 775/1000, Reward: 1223.367, Step: 200 | |
| 2023-04-17 14:33:12 - r - INFO: - Episode: 776/1000, Reward: 1264.269, Step: 200 | |
| 2023-04-17 14:33:13 - r - INFO: - Episode: 777/1000, Reward: 1263.852, Step: 200 | |
| 2023-04-17 14:33:13 - r - INFO: - Episode: 778/1000, Reward: 1200.551, Step: 200 | |
| 2023-04-17 14:33:14 - r - INFO: - Episode: 779/1000, Reward: 1293.500, Step: 200 | |
| 2023-04-17 14:33:15 - r - INFO: - Episode: 780/1000, Reward: 1342.546, Step: 200 | |
| 2023-04-17 14:33:18 - r - INFO: - Episode: 781/1000, Reward: 878.710, Step: 200 | |
| 2023-04-17 14:33:18 - r - INFO: - Episode: 782/1000, Reward: 893.495, Step: 200 | |
| 2023-04-17 14:33:19 - r - INFO: - Episode: 783/1000, Reward: 1216.989, Step: 200 | |
| 2023-04-17 14:33:20 - r - INFO: - Episode: 784/1000, Reward: 1351.573, Step: 200 | |
| 2023-04-17 14:33:20 - r - INFO: - Episode: 785/1000, Reward: 1201.242, Step: 200 | |
| 2023-04-17 14:33:23 - r - INFO: - Episode: 786/1000, Reward: 1253.618, Step: 200 | |
| 2023-04-17 14:33:24 - r - INFO: - Episode: 787/1000, Reward: 1363.773, Step: 200 | |
| 2023-04-17 14:33:25 - r - INFO: - Episode: 788/1000, Reward: 1295.530, Step: 200 | |
| 2023-04-17 14:33:25 - r - INFO: - Episode: 789/1000, Reward: 830.562, Step: 200 | |
| 2023-04-17 14:33:26 - r - INFO: - Episode: 790/1000, Reward: 1273.959, Step: 200 | |
| 2023-04-17 14:33:29 - r - INFO: - Episode: 791/1000, Reward: 1363.947, Step: 200 | |
| 2023-04-17 14:33:30 - r - INFO: - Episode: 792/1000, Reward: 1424.507, Step: 200 | |
| 2023-04-17 14:33:30 - r - INFO: - Episode: 793/1000, Reward: 1228.585, Step: 200 | |
| 2023-04-17 14:33:31 - r - INFO: - Episode: 794/1000, Reward: 783.413, Step: 200 | |
| 2023-04-17 14:33:31 - r - INFO: - Episode: 795/1000, Reward: 1138.351, Step: 200 | |
| 2023-04-17 14:33:35 - r - INFO: - Episode: 796/1000, Reward: 1378.823, Step: 200 | |
| 2023-04-17 14:33:35 - r - INFO: - Episode: 797/1000, Reward: 1124.297, Step: 200 | |
| 2023-04-17 14:33:36 - r - INFO: - Episode: 798/1000, Reward: 1314.003, Step: 200 | |
| 2023-04-17 14:33:36 - r - INFO: - Episode: 799/1000, Reward: 1306.236, Step: 200 | |
| 2023-04-17 14:33:37 - r - INFO: - Episode: 800/1000, Reward: -8.030, Step: 200 | |
| 2023-04-17 14:33:40 - r - INFO: - Episode: 801/1000, Reward: 1261.650, Step: 200 | |
| 2023-04-17 14:33:41 - r - INFO: - Episode: 802/1000, Reward: 1204.928, Step: 200 | |
| 2023-04-17 14:33:42 - r - INFO: - Episode: 803/1000, Reward: 1317.253, Step: 200 | |
| 2023-04-17 14:33:42 - r - INFO: - Episode: 804/1000, Reward: 373.206, Step: 200 | |
| 2023-04-17 14:33:43 - r - INFO: - Episode: 805/1000, Reward: 1308.468, Step: 200 | |
| 2023-04-17 14:33:46 - r - INFO: - Episode: 806/1000, Reward: 1320.623, Step: 200 | |
| 2023-04-17 14:33:47 - r - INFO: - Episode: 807/1000, Reward: 1312.408, Step: 200 | |
| 2023-04-17 14:33:48 - r - INFO: - Episode: 808/1000, Reward: 218.550, Step: 200 | |
| 2023-04-17 14:33:48 - r - INFO: - Episode: 809/1000, Reward: 1361.010, Step: 200 | |
| 2023-04-17 14:33:49 - r - INFO: - Episode: 810/1000, Reward: 1312.133, Step: 200 | |
| 2023-04-17 14:33:52 - r - INFO: - Episode: 811/1000, Reward: 1285.328, Step: 200 | |
| 2023-04-17 14:33:53 - r - INFO: - Episode: 812/1000, Reward: 1349.134, Step: 200 | |
| 2023-04-17 14:33:53 - r - INFO: - Episode: 813/1000, Reward: 1313.963, Step: 200 | |
| 2023-04-17 14:33:54 - r - INFO: - Episode: 814/1000, Reward: 1278.172, Step: 200 | |
| 2023-04-17 14:33:54 - r - INFO: - Episode: 815/1000, Reward: 1387.267, Step: 200 | |
| 2023-04-17 14:33:58 - r - INFO: - Episode: 816/1000, Reward: 1358.309, Step: 200 | |
| 2023-04-17 14:33:58 - r - INFO: - Episode: 817/1000, Reward: 1291.117, Step: 200 | |
| 2023-04-17 14:33:59 - r - INFO: - Episode: 818/1000, Reward: 1364.458, Step: 200 | |
| 2023-04-17 14:34:00 - r - INFO: - Episode: 819/1000, Reward: 1285.375, Step: 200 | |
| 2023-04-17 14:34:00 - r - INFO: - Episode: 820/1000, Reward: 1237.397, Step: 200 | |
| 2023-04-17 14:34:04 - r - INFO: - Episode: 821/1000, Reward: 433.823, Step: 200 | |
| 2023-04-17 14:34:04 - r - INFO: - Episode: 822/1000, Reward: 1247.615, Step: 200 | |
| 2023-04-17 14:34:05 - r - INFO: - Episode: 823/1000, Reward: 1297.220, Step: 200 | |
| 2023-04-17 14:34:05 - r - INFO: - Episode: 824/1000, Reward: 1374.596, Step: 200 | |
| 2023-04-17 14:34:06 - r - INFO: - Episode: 825/1000, Reward: 1353.748, Step: 200 | |
| 2023-04-17 14:34:09 - r - INFO: - Episode: 826/1000, Reward: 1363.126, Step: 200 | |
| 2023-04-17 14:34:10 - r - INFO: - Episode: 827/1000, Reward: 1375.929, Step: 200 | |
| 2023-04-17 14:34:10 - r - INFO: - Episode: 828/1000, Reward: 1261.021, Step: 200 | |
| 2023-04-17 14:34:11 - r - INFO: - Episode: 829/1000, Reward: 1254.114, Step: 200 | |
| 2023-04-17 14:34:11 - r - INFO: - Episode: 830/1000, Reward: 1257.492, Step: 200 | |
| 2023-04-17 14:34:15 - r - INFO: - Episode: 831/1000, Reward: 1198.346, Step: 200 | |
| 2023-04-17 14:34:15 - r - INFO: - Episode: 832/1000, Reward: 1251.994, Step: 200 | |
| 2023-04-17 14:34:16 - r - INFO: - Episode: 833/1000, Reward: 1171.787, Step: 200 | |
| 2023-04-17 14:34:17 - r - INFO: - Episode: 834/1000, Reward: 1234.845, Step: 200 | |
| 2023-04-17 14:34:17 - r - INFO: - Episode: 835/1000, Reward: 1219.072, Step: 200 | |
| 2023-04-17 14:34:20 - r - INFO: - Episode: 836/1000, Reward: 1268.738, Step: 200 | |
| 2023-04-17 14:34:21 - r - INFO: - Episode: 837/1000, Reward: 1186.579, Step: 200 | |
| 2023-04-17 14:34:21 - r - INFO: - Episode: 838/1000, Reward: 1120.019, Step: 200 | |
| 2023-04-17 14:34:22 - r - INFO: - Episode: 839/1000, Reward: 1237.924, Step: 200 | |
| 2023-04-17 14:34:23 - r - INFO: - Episode: 840/1000, Reward: 1199.324, Step: 200 | |
| 2023-04-17 14:34:26 - r - INFO: - Episode: 841/1000, Reward: 1117.867, Step: 200 | |
| 2023-04-17 14:34:27 - r - INFO: - Episode: 842/1000, Reward: 1316.922, Step: 200 | |
| 2023-04-17 14:34:27 - r - INFO: - Episode: 843/1000, Reward: 1255.758, Step: 200 | |
| 2023-04-17 14:34:28 - r - INFO: - Episode: 844/1000, Reward: 1278.911, Step: 200 | |
| 2023-04-17 14:34:28 - r - INFO: - Episode: 845/1000, Reward: 1152.790, Step: 200 | |
| 2023-04-17 14:34:32 - r - INFO: - Episode: 846/1000, Reward: 1231.821, Step: 200 | |
| 2023-04-17 14:34:32 - r - INFO: - Episode: 847/1000, Reward: 1219.756, Step: 200 | |
| 2023-04-17 14:34:33 - r - INFO: - Episode: 848/1000, Reward: 1279.726, Step: 200 | |
| 2023-04-17 14:34:33 - r - INFO: - Episode: 849/1000, Reward: 647.142, Step: 200 | |
| 2023-04-17 14:34:34 - r - INFO: - Episode: 850/1000, Reward: 1220.165, Step: 200 | |
| 2023-04-17 14:34:38 - r - INFO: - Episode: 851/1000, Reward: 500.702, Step: 200 | |
| 2023-04-17 14:34:38 - r - INFO: - Episode: 852/1000, Reward: 1270.383, Step: 200 | |
| 2023-04-17 14:34:39 - r - INFO: - Episode: 853/1000, Reward: 1281.054, Step: 200 | |
| 2023-04-17 14:34:40 - r - INFO: - Episode: 854/1000, Reward: 1358.648, Step: 200 | |
| 2023-04-17 14:34:40 - r - INFO: - Episode: 855/1000, Reward: 1365.848, Step: 200 | |
| 2023-04-17 14:34:44 - r - INFO: - Episode: 856/1000, Reward: 1377.216, Step: 200 | |
| 2023-04-17 14:34:44 - r - INFO: - Episode: 857/1000, Reward: 1203.801, Step: 200 | |
| 2023-04-17 14:34:45 - r - INFO: - Episode: 858/1000, Reward: 1320.780, Step: 200 | |
| 2023-04-17 14:34:46 - r - INFO: - Episode: 859/1000, Reward: 1044.309, Step: 200 | |
| 2023-04-17 14:34:46 - r - INFO: - Episode: 860/1000, Reward: 1292.777, Step: 200 | |
| 2023-04-17 14:34:50 - r - INFO: - Episode: 861/1000, Reward: 1332.000, Step: 200 | |
| 2023-04-17 14:34:50 - r - INFO: - Episode: 862/1000, Reward: 1103.872, Step: 200 | |
| 2023-04-17 14:34:51 - r - INFO: - Episode: 863/1000, Reward: 1273.461, Step: 200 | |
| 2023-04-17 14:34:52 - r - INFO: - Episode: 864/1000, Reward: 1111.698, Step: 200 | |
| 2023-04-17 14:34:52 - r - INFO: - Episode: 865/1000, Reward: 1293.764, Step: 200 | |
| 2023-04-17 14:34:56 - r - INFO: - Episode: 866/1000, Reward: 1295.572, Step: 200 | |
| 2023-04-17 14:34:57 - r - INFO: - Episode: 867/1000, Reward: 1227.364, Step: 200 | |
| 2023-04-17 14:34:57 - r - INFO: - Episode: 868/1000, Reward: 850.904, Step: 200 | |
| 2023-04-17 14:34:58 - r - INFO: - Episode: 869/1000, Reward: 1205.854, Step: 200 | |
| 2023-04-17 14:34:58 - r - INFO: - Episode: 870/1000, Reward: 1139.253, Step: 200 | |
| 2023-04-17 14:35:02 - r - INFO: - Episode: 871/1000, Reward: 1245.345, Step: 200 | |
| 2023-04-17 14:35:03 - r - INFO: - Episode: 872/1000, Reward: 1053.338, Step: 200 | |
| 2023-04-17 14:35:03 - r - INFO: - Episode: 873/1000, Reward: 1317.996, Step: 200 | |
| 2023-04-17 14:35:04 - r - INFO: - Episode: 874/1000, Reward: 1334.646, Step: 200 | |
| 2023-04-17 14:35:04 - r - INFO: - Episode: 875/1000, Reward: 1283.764, Step: 200 | |
| 2023-04-17 14:35:08 - r - INFO: - Episode: 876/1000, Reward: 1414.084, Step: 200 | |
| 2023-04-17 14:35:08 - r - INFO: - Episode: 877/1000, Reward: 1305.049, Step: 200 | |
| 2023-04-17 14:35:09 - r - INFO: - Episode: 878/1000, Reward: 1212.828, Step: 200 | |
| 2023-04-17 14:35:09 - r - INFO: - Episode: 879/1000, Reward: 1297.015, Step: 200 | |
| 2023-04-17 14:35:10 - r - INFO: - Episode: 880/1000, Reward: 1343.653, Step: 200 | |
| 2023-04-17 14:35:14 - r - INFO: - Episode: 881/1000, Reward: 1292.702, Step: 200 | |
| 2023-04-17 14:35:14 - r - INFO: - Episode: 882/1000, Reward: 1415.727, Step: 200 | |
| 2023-04-17 14:35:15 - r - INFO: - Episode: 883/1000, Reward: 1264.775, Step: 200 | |
| 2023-04-17 14:35:15 - r - INFO: - Episode: 884/1000, Reward: 1024.746, Step: 200 | |
| 2023-04-17 14:35:16 - r - INFO: - Episode: 885/1000, Reward: 996.594, Step: 200 | |
| 2023-04-17 14:35:19 - r - INFO: - Episode: 886/1000, Reward: 1285.247, Step: 200 | |
| 2023-04-17 14:35:20 - r - INFO: - Episode: 887/1000, Reward: 1256.301, Step: 200 | |
| 2023-04-17 14:35:20 - r - INFO: - Episode: 888/1000, Reward: 1276.012, Step: 200 | |
| 2023-04-17 14:35:21 - r - INFO: - Episode: 889/1000, Reward: 1331.189, Step: 200 | |
| 2023-04-17 14:35:22 - r - INFO: - Episode: 890/1000, Reward: 1094.204, Step: 200 | |
| 2023-04-17 14:35:25 - r - INFO: - Episode: 891/1000, Reward: 1155.441, Step: 200 | |
| 2023-04-17 14:35:26 - r - INFO: - Episode: 892/1000, Reward: 1360.832, Step: 200 | |
| 2023-04-17 14:35:26 - r - INFO: - Episode: 893/1000, Reward: 1305.256, Step: 200 | |
| 2023-04-17 14:35:27 - r - INFO: - Episode: 894/1000, Reward: 1369.040, Step: 200 | |
| 2023-04-17 14:35:27 - r - INFO: - Episode: 895/1000, Reward: 1094.902, Step: 200 | |
| 2023-04-17 14:35:31 - r - INFO: - Episode: 896/1000, Reward: 260.662, Step: 200 | |
| 2023-04-17 14:35:32 - r - INFO: - Episode: 897/1000, Reward: 1292.906, Step: 200 | |
| 2023-04-17 14:35:32 - r - INFO: - Episode: 898/1000, Reward: 1140.988, Step: 200 | |
| 2023-04-17 14:35:33 - r - INFO: - Episode: 899/1000, Reward: 1228.286, Step: 200 | |
| 2023-04-17 14:35:34 - r - INFO: - Episode: 900/1000, Reward: 1314.350, Step: 200 | |
| 2023-04-17 14:35:37 - r - INFO: - Episode: 901/1000, Reward: 1335.637, Step: 200 | |
| 2023-04-17 14:35:38 - r - INFO: - Episode: 902/1000, Reward: 1347.558, Step: 200 | |
| 2023-04-17 14:35:38 - r - INFO: - Episode: 903/1000, Reward: 1340.510, Step: 200 | |
| 2023-04-17 14:35:39 - r - INFO: - Episode: 904/1000, Reward: 1327.608, Step: 200 | |
| 2023-04-17 14:35:40 - r - INFO: - Episode: 905/1000, Reward: 1294.383, Step: 200 | |
| 2023-04-17 14:35:43 - r - INFO: - Episode: 906/1000, Reward: 1255.816, Step: 200 | |
| 2023-04-17 14:35:44 - r - INFO: - Episode: 907/1000, Reward: 1376.404, Step: 200 | |
| 2023-04-17 14:35:44 - r - INFO: - Episode: 908/1000, Reward: 1343.875, Step: 200 | |
| 2023-04-17 14:35:45 - r - INFO: - Episode: 909/1000, Reward: 1349.540, Step: 200 | |
| 2023-04-17 14:35:46 - r - INFO: - Episode: 910/1000, Reward: 1298.711, Step: 200 | |
| 2023-04-17 14:35:49 - r - INFO: - Episode: 911/1000, Reward: 1295.301, Step: 200 | |
| 2023-04-17 14:35:50 - r - INFO: - Episode: 912/1000, Reward: 1356.655, Step: 200 | |
| 2023-04-17 14:35:50 - r - INFO: - Episode: 913/1000, Reward: 1410.249, Step: 200 | |
| 2023-04-17 14:35:51 - r - INFO: - Episode: 914/1000, Reward: 1265.445, Step: 200 | |
| 2023-04-17 14:35:51 - r - INFO: - Episode: 915/1000, Reward: 1418.927, Step: 200 | |
| 2023-04-17 14:35:55 - r - INFO: - Episode: 916/1000, Reward: 1363.484, Step: 200 | |
| 2023-04-17 14:35:55 - r - INFO: - Episode: 917/1000, Reward: 1439.892, Step: 200 | |
| 2023-04-17 14:35:56 - r - INFO: - Episode: 918/1000, Reward: 1300.727, Step: 200 | |
| 2023-04-17 14:35:57 - r - INFO: - Episode: 919/1000, Reward: 1238.133, Step: 200 | |
| 2023-04-17 14:35:57 - r - INFO: - Episode: 920/1000, Reward: 1358.927, Step: 200 | |
| 2023-04-17 14:36:01 - r - INFO: - Episode: 921/1000, Reward: 1365.792, Step: 200 | |
| 2023-04-17 14:36:01 - r - INFO: - Episode: 922/1000, Reward: 1352.012, Step: 200 | |
| 2023-04-17 14:36:02 - r - INFO: - Episode: 923/1000, Reward: 1079.368, Step: 200 | |
| 2023-04-17 14:36:02 - r - INFO: - Episode: 924/1000, Reward: 1288.186, Step: 200 | |
| 2023-04-17 14:36:03 - r - INFO: - Episode: 925/1000, Reward: 1315.143, Step: 200 | |
| 2023-04-17 14:36:06 - r - INFO: - Episode: 926/1000, Reward: 1214.652, Step: 200 | |
| 2023-04-17 14:36:07 - r - INFO: - Episode: 927/1000, Reward: 1358.633, Step: 200 | |
| 2023-04-17 14:36:07 - r - INFO: - Episode: 928/1000, Reward: 1166.570, Step: 200 | |
| 2023-04-17 14:36:08 - r - INFO: - Episode: 929/1000, Reward: 1281.574, Step: 200 | |
| 2023-04-17 14:36:09 - r - INFO: - Episode: 930/1000, Reward: 1258.010, Step: 200 | |
| 2023-04-17 14:36:12 - r - INFO: - Episode: 931/1000, Reward: 1278.305, Step: 200 | |
| 2023-04-17 14:36:13 - r - INFO: - Episode: 932/1000, Reward: 1333.524, Step: 200 | |
| 2023-04-17 14:36:14 - r - INFO: - Episode: 933/1000, Reward: 1127.434, Step: 200 | |
| 2023-04-17 14:36:14 - r - INFO: - Episode: 934/1000, Reward: 1371.973, Step: 200 | |
| 2023-04-17 14:36:15 - r - INFO: - Episode: 935/1000, Reward: 617.937, Step: 200 | |
| 2023-04-17 14:36:18 - r - INFO: - Episode: 936/1000, Reward: 1208.974, Step: 200 | |
| 2023-04-17 14:36:19 - r - INFO: - Episode: 937/1000, Reward: 1267.401, Step: 200 | |
| 2023-04-17 14:36:19 - r - INFO: - Episode: 938/1000, Reward: 1338.556, Step: 200 | |
| 2023-04-17 14:36:20 - r - INFO: - Episode: 939/1000, Reward: 1200.754, Step: 200 | |
| 2023-04-17 14:36:21 - r - INFO: - Episode: 940/1000, Reward: 1337.489, Step: 200 | |
| 2023-04-17 14:36:24 - r - INFO: - Episode: 941/1000, Reward: 1109.018, Step: 200 | |
| 2023-04-17 14:36:25 - r - INFO: - Episode: 942/1000, Reward: 946.854, Step: 200 | |
| 2023-04-17 14:36:26 - r - INFO: - Episode: 943/1000, Reward: 377.449, Step: 200 | |
| 2023-04-17 14:36:26 - r - INFO: - Episode: 944/1000, Reward: 1150.810, Step: 200 | |
| 2023-04-17 14:36:27 - r - INFO: - Episode: 945/1000, Reward: 1400.813, Step: 200 | |
| 2023-04-17 14:36:30 - r - INFO: - Current episode 945 has the best eval reward: 1328.293 | |
| 2023-04-17 14:36:30 - r - INFO: - Episode: 946/1000, Reward: 1274.516, Step: 200 | |
| 2023-04-17 14:36:31 - r - INFO: - Episode: 947/1000, Reward: 1225.964, Step: 200 | |
| 2023-04-17 14:36:32 - r - INFO: - Episode: 948/1000, Reward: 1360.490, Step: 200 | |
| 2023-04-17 14:36:32 - r - INFO: - Episode: 949/1000, Reward: 1207.276, Step: 200 | |
| 2023-04-17 14:36:33 - r - INFO: - Episode: 950/1000, Reward: 1248.215, Step: 200 | |
| 2023-04-17 14:36:37 - r - INFO: - Episode: 951/1000, Reward: 1419.342, Step: 200 | |
| 2023-04-17 14:36:37 - r - INFO: - Episode: 952/1000, Reward: 1369.437, Step: 200 | |
| 2023-04-17 14:36:38 - r - INFO: - Episode: 953/1000, Reward: 1273.212, Step: 200 | |
| 2023-04-17 14:36:38 - r - INFO: - Episode: 954/1000, Reward: 1348.288, Step: 200 | |
| 2023-04-17 14:36:39 - r - INFO: - Episode: 955/1000, Reward: 864.327, Step: 200 | |
| 2023-04-17 14:36:42 - r - INFO: - Episode: 956/1000, Reward: 1250.877, Step: 200 | |
| 2023-04-17 14:36:43 - r - INFO: - Episode: 957/1000, Reward: 1365.514, Step: 200 | |
| 2023-04-17 14:36:43 - r - INFO: - Episode: 958/1000, Reward: 1312.808, Step: 200 | |
| 2023-04-17 14:36:44 - r - INFO: - Episode: 959/1000, Reward: 1102.645, Step: 200 | |
| 2023-04-17 14:36:45 - r - INFO: - Episode: 960/1000, Reward: 1323.509, Step: 200 | |
| 2023-04-17 14:36:48 - r - INFO: - Episode: 961/1000, Reward: 1287.600, Step: 200 | |
| 2023-04-17 14:36:49 - r - INFO: - Episode: 962/1000, Reward: 1179.983, Step: 200 | |
| 2023-04-17 14:36:49 - r - INFO: - Episode: 963/1000, Reward: 1248.916, Step: 200 | |
| 2023-04-17 14:36:50 - r - INFO: - Episode: 964/1000, Reward: 1281.686, Step: 200 | |
| 2023-04-17 14:36:50 - r - INFO: - Episode: 965/1000, Reward: 1327.644, Step: 200 | |
| 2023-04-17 14:36:54 - r - INFO: - Episode: 966/1000, Reward: 1240.872, Step: 200 | |
| 2023-04-17 14:36:55 - r - INFO: - Episode: 967/1000, Reward: 1325.715, Step: 200 | |
| 2023-04-17 14:36:55 - r - INFO: - Episode: 968/1000, Reward: 1264.296, Step: 200 | |
| 2023-04-17 14:36:56 - r - INFO: - Episode: 969/1000, Reward: 1019.349, Step: 200 | |
| 2023-04-17 14:36:56 - r - INFO: - Episode: 970/1000, Reward: 1285.969, Step: 200 | |
| 2023-04-17 14:37:00 - r - INFO: - Episode: 971/1000, Reward: 1354.423, Step: 200 | |
| 2023-04-17 14:37:01 - r - INFO: - Episode: 972/1000, Reward: 1307.282, Step: 200 | |
| 2023-04-17 14:37:01 - r - INFO: - Episode: 973/1000, Reward: 1279.104, Step: 200 | |
| 2023-04-17 14:37:02 - r - INFO: - Episode: 974/1000, Reward: 1331.231, Step: 200 | |
| 2023-04-17 14:37:02 - r - INFO: - Episode: 975/1000, Reward: 1282.538, Step: 200 | |
| 2023-04-17 14:37:06 - r - INFO: - Episode: 976/1000, Reward: 1303.137, Step: 200 | |
| 2023-04-17 14:37:07 - r - INFO: - Episode: 977/1000, Reward: 1116.645, Step: 200 | |
| 2023-04-17 14:37:07 - r - INFO: - Episode: 978/1000, Reward: 1263.702, Step: 200 | |
| 2023-04-17 14:37:08 - r - INFO: - Episode: 979/1000, Reward: 1394.170, Step: 200 | |
| 2023-04-17 14:37:09 - r - INFO: - Episode: 980/1000, Reward: 1237.394, Step: 200 | |
| 2023-04-17 14:37:13 - r - INFO: - Episode: 981/1000, Reward: 986.832, Step: 200 | |
| 2023-04-17 14:37:13 - r - INFO: - Episode: 982/1000, Reward: 1324.843, Step: 200 | |
| 2023-04-17 14:37:14 - r - INFO: - Episode: 983/1000, Reward: 1297.139, Step: 200 | |
| 2023-04-17 14:37:14 - r - INFO: - Episode: 984/1000, Reward: 498.473, Step: 200 | |
| 2023-04-17 14:37:15 - r - INFO: - Episode: 985/1000, Reward: 1206.221, Step: 200 | |
| 2023-04-17 14:37:19 - r - INFO: - Episode: 986/1000, Reward: 1271.213, Step: 200 | |
| 2023-04-17 14:37:19 - r - INFO: - Episode: 987/1000, Reward: 1354.592, Step: 200 | |
| 2023-04-17 14:37:20 - r - INFO: - Episode: 988/1000, Reward: 1061.141, Step: 200 | |
| 2023-04-17 14:37:21 - r - INFO: - Episode: 989/1000, Reward: 1337.815, Step: 200 | |
| 2023-04-17 14:37:21 - r - INFO: - Episode: 990/1000, Reward: 1066.556, Step: 200 | |
| 2023-04-17 14:37:25 - r - INFO: - Episode: 991/1000, Reward: 1237.234, Step: 200 | |
| 2023-04-17 14:37:25 - r - INFO: - Episode: 992/1000, Reward: 1404.495, Step: 200 | |
| 2023-04-17 14:37:26 - r - INFO: - Episode: 993/1000, Reward: 1128.712, Step: 200 | |
| 2023-04-17 14:37:26 - r - INFO: - Episode: 994/1000, Reward: 1295.569, Step: 200 | |
| 2023-04-17 14:37:27 - r - INFO: - Episode: 995/1000, Reward: 1304.900, Step: 200 | |
| 2023-04-17 14:37:31 - r - INFO: - Episode: 996/1000, Reward: 1183.400, Step: 200 | |
| 2023-04-17 14:37:31 - r - INFO: - Episode: 997/1000, Reward: 1263.613, Step: 200 | |
| 2023-04-17 14:37:32 - r - INFO: - Episode: 998/1000, Reward: 1136.181, Step: 200 | |
| 2023-04-17 14:37:32 - r - INFO: - Episode: 999/1000, Reward: 1404.283, Step: 200 | |
| 2023-04-17 14:37:33 - r - INFO: - Episode: 1000/1000, Reward: 1171.637, Step: 200 | |
| 2023-04-17 14:37:36 - r - INFO: - Finish training! | |