johnjim0816
add all benchmarks
62e03a2
raw
history blame
166 kB
2023-04-14 21:42:11 - r - INFO: - Hyperparameters:
2023-04-14 21:42:11 - r - INFO: - ================================================================================
2023-04-14 21:42:11 - r - INFO: - Name Value Type
2023-04-14 21:42:11 - r - INFO: - env_name BipedalWalker-v3 <class 'str'>
2023-04-14 21:42:11 - r - INFO: - new_step_api 1 <class 'bool'>
2023-04-14 21:42:11 - r - INFO: - wrapper None <class 'str'>
2023-04-14 21:42:11 - r - INFO: - render 0 <class 'bool'>
2023-04-14 21:42:11 - r - INFO: - render_mode human <class 'str'>
2023-04-14 21:42:11 - r - INFO: - algo_name DDPG <class 'str'>
2023-04-14 21:42:11 - r - INFO: - mode train <class 'str'>
2023-04-14 21:42:11 - r - INFO: - mp_backend mp <class 'str'>
2023-04-14 21:42:11 - r - INFO: - seed 2023 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - device cpu <class 'str'>
2023-04-14 21:42:11 - r - INFO: - train_eps 2000 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - test_eps 3 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - eval_eps 10 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - eval_per_episode 20 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - max_steps 300 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - load_checkpoint 0 <class 'bool'>
2023-04-14 21:42:11 - r - INFO: - load_path Train_BipedalWalker-v3_DDPG_20230414-201956 <class 'str'>
2023-04-14 21:42:11 - r - INFO: - show_fig 0 <class 'bool'>
2023-04-14 21:42:11 - r - INFO: - save_fig 1 <class 'bool'>
2023-04-14 21:42:11 - r - INFO: - n_workers 1 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - gamma 0.99 <class 'float'>
2023-04-14 21:42:11 - r - INFO: - critic_lr 0.001 <class 'float'>
2023-04-14 21:42:11 - r - INFO: - actor_lr 5e-05 <class 'float'>
2023-04-14 21:42:11 - r - INFO: - buffer_size 20480 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - batch_size 256 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - tau 0.01 <class 'float'>
2023-04-14 21:42:11 - r - INFO: - critic_hidden_dim 128 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - actor_hidden_dim 128 <class 'int'>
2023-04-14 21:42:11 - r - INFO: - task_dir D:\Python_data\gihub_project\joyrl-offline/tasks/Train_BipedalWalker-v3_DDPG_20230414-214211 <class 'str'>
2023-04-14 21:42:11 - r - INFO: - res_dir D:\Python_data\gihub_project\joyrl-offline/tasks/Train_BipedalWalker-v3_DDPG_20230414-214211/results <class 'str'>
2023-04-14 21:42:11 - r - INFO: - log_dir D:\Python_data\gihub_project\joyrl-offline/tasks/Train_BipedalWalker-v3_DDPG_20230414-214211/logs <class 'str'>
2023-04-14 21:42:11 - r - INFO: - traj_dir D:\Python_data\gihub_project\joyrl-offline/tasks/Train_BipedalWalker-v3_DDPG_20230414-214211/traj <class 'str'>
2023-04-14 21:42:11 - r - INFO: - video_dir D:\Python_data\gihub_project\joyrl-offline/tasks/Train_BipedalWalker-v3_DDPG_20230414-214211/videos <class 'str'>
2023-04-14 21:42:11 - r - INFO: - ================================================================================
2023-04-14 21:42:11 - r - INFO: - action_bound: 1.0
2023-04-14 21:42:11 - r - INFO: - n_states: 24, n_actions: 4
2023-04-14 21:42:11 - r - INFO: - Start training!
2023-04-14 21:42:11 - r - INFO: - Env: BipedalWalker-v3, Algorithm: DDPG, Device: cpu
2023-04-14 21:42:11 - r - INFO: - Episode: 1/2000, Reward: -109.112, Step: 185
2023-04-14 21:42:12 - r - INFO: - Episode: 2/2000, Reward: -100.860, Step: 78
2023-04-14 21:42:13 - r - INFO: - Episode: 3/2000, Reward: -106.094, Step: 57
2023-04-14 21:42:15 - r - INFO: - Episode: 4/2000, Reward: -122.972, Step: 105
2023-04-14 21:42:17 - r - INFO: - Episode: 5/2000, Reward: -115.262, Step: 44
2023-04-14 21:42:22 - r - INFO: - Episode: 6/2000, Reward: -13.242, Step: 300
2023-04-14 21:42:23 - r - INFO: - Episode: 7/2000, Reward: -121.542, Step: 42
2023-04-14 21:42:25 - r - INFO: - Episode: 8/2000, Reward: -110.970, Step: 105
2023-04-14 21:42:28 - r - INFO: - Episode: 9/2000, Reward: -115.359, Step: 127
2023-04-14 21:42:32 - r - INFO: - Episode: 10/2000, Reward: -130.550, Step: 236
2023-04-14 21:42:38 - r - INFO: - Episode: 11/2000, Reward: -33.805, Step: 300
2023-04-14 21:42:41 - r - INFO: - Episode: 12/2000, Reward: -118.993, Step: 153
2023-04-14 21:42:46 - r - INFO: - Episode: 13/2000, Reward: -17.596, Step: 300
2023-04-14 21:42:48 - r - INFO: - Episode: 14/2000, Reward: -117.660, Step: 117
2023-04-14 21:42:54 - r - INFO: - Episode: 15/2000, Reward: -16.641, Step: 300
2023-04-14 21:43:00 - r - INFO: - Episode: 16/2000, Reward: -23.547, Step: 300
2023-04-14 21:43:05 - r - INFO: - Episode: 17/2000, Reward: -21.802, Step: 300
2023-04-14 21:43:10 - r - INFO: - Episode: 18/2000, Reward: -22.084, Step: 300
2023-04-14 21:43:16 - r - INFO: - Episode: 19/2000, Reward: -26.890, Step: 300
2023-04-14 21:43:23 - r - INFO: - Episode: 20/2000, Reward: -19.628, Step: 300
2023-04-14 21:43:29 - r - INFO: - Current episode 20 has the best eval reward: -23.388
2023-04-14 21:43:36 - r - INFO: - Episode: 21/2000, Reward: -113.434, Step: 282
2023-04-14 21:43:42 - r - INFO: - Episode: 22/2000, Reward: -16.413, Step: 300
2023-04-14 21:43:48 - r - INFO: - Episode: 23/2000, Reward: -24.658, Step: 300
2023-04-14 21:43:53 - r - INFO: - Episode: 24/2000, Reward: -19.759, Step: 300
2023-04-14 21:43:58 - r - INFO: - Episode: 25/2000, Reward: -18.339, Step: 300
2023-04-14 21:44:03 - r - INFO: - Episode: 26/2000, Reward: -20.764, Step: 300
2023-04-14 21:44:08 - r - INFO: - Episode: 27/2000, Reward: -25.039, Step: 300
2023-04-14 21:44:13 - r - INFO: - Episode: 28/2000, Reward: -21.535, Step: 300
2023-04-14 21:44:17 - r - INFO: - Episode: 29/2000, Reward: -118.795, Step: 224
2023-04-14 21:44:18 - r - INFO: - Episode: 30/2000, Reward: -115.984, Step: 67
2023-04-14 21:44:20 - r - INFO: - Episode: 31/2000, Reward: -115.901, Step: 67
2023-04-14 21:44:20 - r - INFO: - Episode: 32/2000, Reward: -112.128, Step: 50
2023-04-14 21:44:21 - r - INFO: - Episode: 33/2000, Reward: -111.155, Step: 44
2023-04-14 21:44:23 - r - INFO: - Episode: 34/2000, Reward: -104.336, Step: 93
2023-04-14 21:44:24 - r - INFO: - Episode: 35/2000, Reward: -114.617, Step: 62
2023-04-14 21:44:25 - r - INFO: - Episode: 36/2000, Reward: -113.158, Step: 52
2023-04-14 21:44:25 - r - INFO: - Episode: 37/2000, Reward: -111.612, Step: 41
2023-04-14 21:44:26 - r - INFO: - Episode: 38/2000, Reward: -110.226, Step: 46
2023-04-14 21:44:27 - r - INFO: - Episode: 39/2000, Reward: -114.134, Step: 64
2023-04-14 21:44:32 - r - INFO: - Episode: 40/2000, Reward: -29.079, Step: 300
2023-04-14 21:44:43 - r - INFO: - Episode: 41/2000, Reward: -34.994, Step: 300
2023-04-14 21:44:48 - r - INFO: - Episode: 42/2000, Reward: -28.210, Step: 300
2023-04-14 21:44:53 - r - INFO: - Episode: 43/2000, Reward: -26.793, Step: 300
2023-04-14 21:44:58 - r - INFO: - Episode: 44/2000, Reward: -29.962, Step: 300
2023-04-14 21:45:04 - r - INFO: - Episode: 45/2000, Reward: -28.751, Step: 300
2023-04-14 21:45:09 - r - INFO: - Episode: 46/2000, Reward: -28.505, Step: 300
2023-04-14 21:45:10 - r - INFO: - Episode: 47/2000, Reward: -114.122, Step: 36
2023-04-14 21:45:10 - r - INFO: - Episode: 48/2000, Reward: -114.088, Step: 41
2023-04-14 21:45:19 - r - INFO: - Episode: 49/2000, Reward: -25.577, Step: 300
2023-04-14 21:45:26 - r - INFO: - Episode: 50/2000, Reward: -23.633, Step: 300
2023-04-14 21:45:27 - r - INFO: - Episode: 51/2000, Reward: -113.772, Step: 42
2023-04-14 21:45:30 - r - INFO: - Episode: 52/2000, Reward: -125.206, Step: 116
2023-04-14 21:45:35 - r - INFO: - Episode: 53/2000, Reward: -21.013, Step: 300
2023-04-14 21:45:36 - r - INFO: - Episode: 54/2000, Reward: -117.215, Step: 48
2023-04-14 21:45:37 - r - INFO: - Episode: 55/2000, Reward: -117.234, Step: 52
2023-04-14 21:45:42 - r - INFO: - Episode: 56/2000, Reward: -29.327, Step: 300
2023-04-14 21:45:43 - r - INFO: - Episode: 57/2000, Reward: -117.063, Step: 47
2023-04-14 21:45:44 - r - INFO: - Episode: 58/2000, Reward: -113.742, Step: 39
2023-04-14 21:45:45 - r - INFO: - Episode: 59/2000, Reward: -123.294, Step: 89
2023-04-14 21:45:51 - r - INFO: - Episode: 60/2000, Reward: -23.202, Step: 300
2023-04-14 21:45:58 - r - INFO: - Episode: 61/2000, Reward: -33.771, Step: 300
2023-04-14 21:46:00 - r - INFO: - Episode: 62/2000, Reward: -108.161, Step: 64
2023-04-14 21:46:06 - r - INFO: - Episode: 63/2000, Reward: -29.419, Step: 300
2023-04-14 21:46:11 - r - INFO: - Episode: 64/2000, Reward: -101.811, Step: 122
2023-04-14 21:46:14 - r - INFO: - Episode: 65/2000, Reward: -108.055, Step: 124
2023-04-14 21:46:21 - r - INFO: - Episode: 66/2000, Reward: -26.285, Step: 300
2023-04-14 21:46:22 - r - INFO: - Episode: 67/2000, Reward: -107.422, Step: 75
2023-04-14 21:46:24 - r - INFO: - Episode: 68/2000, Reward: -111.807, Step: 129
2023-04-14 21:46:27 - r - INFO: - Episode: 69/2000, Reward: -101.434, Step: 131
2023-04-14 21:46:29 - r - INFO: - Episode: 70/2000, Reward: -112.775, Step: 128
2023-04-14 21:46:31 - r - INFO: - Episode: 71/2000, Reward: -110.311, Step: 71
2023-04-14 21:46:33 - r - INFO: - Episode: 72/2000, Reward: -99.563, Step: 114
2023-04-14 21:46:36 - r - INFO: - Episode: 73/2000, Reward: -109.423, Step: 126
2023-04-14 21:46:42 - r - INFO: - Episode: 74/2000, Reward: -31.711, Step: 300
2023-04-14 21:46:48 - r - INFO: - Episode: 75/2000, Reward: -17.547, Step: 300
2023-04-14 21:46:50 - r - INFO: - Episode: 76/2000, Reward: -119.460, Step: 64
2023-04-14 21:46:55 - r - INFO: - Episode: 77/2000, Reward: -22.546, Step: 300
2023-04-14 21:46:58 - r - INFO: - Episode: 78/2000, Reward: -106.006, Step: 163
2023-04-14 21:47:05 - r - INFO: - Episode: 79/2000, Reward: -30.913, Step: 300
2023-04-14 21:47:13 - r - INFO: - Episode: 80/2000, Reward: -20.373, Step: 300
2023-04-14 21:47:23 - r - INFO: - Episode: 81/2000, Reward: -25.565, Step: 300
2023-04-14 21:47:30 - r - INFO: - Episode: 82/2000, Reward: -28.357, Step: 300
2023-04-14 21:47:37 - r - INFO: - Episode: 83/2000, Reward: -26.506, Step: 300
2023-04-14 21:47:47 - r - INFO: - Episode: 84/2000, Reward: -27.160, Step: 300
2023-04-14 21:47:54 - r - INFO: - Episode: 85/2000, Reward: -27.436, Step: 300
2023-04-14 21:48:01 - r - INFO: - Episode: 86/2000, Reward: -28.297, Step: 300
2023-04-14 21:48:08 - r - INFO: - Episode: 87/2000, Reward: -25.462, Step: 300
2023-04-14 21:48:13 - r - INFO: - Episode: 88/2000, Reward: -28.484, Step: 300
2023-04-14 21:48:20 - r - INFO: - Episode: 89/2000, Reward: -28.667, Step: 300
2023-04-14 21:48:28 - r - INFO: - Episode: 90/2000, Reward: -27.735, Step: 300
2023-04-14 21:48:37 - r - INFO: - Episode: 91/2000, Reward: -26.747, Step: 300
2023-04-14 21:48:46 - r - INFO: - Episode: 92/2000, Reward: -18.252, Step: 300
2023-04-14 21:48:48 - r - INFO: - Episode: 93/2000, Reward: -106.641, Step: 124
2023-04-14 21:48:53 - r - INFO: - Episode: 94/2000, Reward: -22.984, Step: 300
2023-04-14 21:48:54 - r - INFO: - Episode: 95/2000, Reward: -110.767, Step: 55
2023-04-14 21:48:55 - r - INFO: - Episode: 96/2000, Reward: -122.389, Step: 58
2023-04-14 21:48:58 - r - INFO: - Episode: 97/2000, Reward: -113.438, Step: 144
2023-04-14 21:49:00 - r - INFO: - Episode: 98/2000, Reward: -117.842, Step: 118
2023-04-14 21:49:02 - r - INFO: - Episode: 99/2000, Reward: -104.387, Step: 96
2023-04-14 21:49:04 - r - INFO: - Episode: 100/2000, Reward: -129.942, Step: 119
2023-04-14 21:49:08 - r - INFO: - Current episode 100 has the best eval reward: -23.255
2023-04-14 21:49:09 - r - INFO: - Episode: 101/2000, Reward: -121.974, Step: 69
2023-04-14 21:49:10 - r - INFO: - Episode: 102/2000, Reward: -119.786, Step: 78
2023-04-14 21:49:16 - r - INFO: - Episode: 103/2000, Reward: -23.827, Step: 300
2023-04-14 21:49:18 - r - INFO: - Episode: 104/2000, Reward: -127.492, Step: 99
2023-04-14 21:49:23 - r - INFO: - Episode: 105/2000, Reward: -21.964, Step: 300
2023-04-14 21:49:29 - r - INFO: - Episode: 106/2000, Reward: -25.955, Step: 300
2023-04-14 21:49:35 - r - INFO: - Episode: 107/2000, Reward: -18.989, Step: 300
2023-04-14 21:49:42 - r - INFO: - Episode: 108/2000, Reward: -24.117, Step: 300
2023-04-14 21:49:43 - r - INFO: - Episode: 109/2000, Reward: -118.645, Step: 53
2023-04-14 21:49:45 - r - INFO: - Episode: 110/2000, Reward: -121.282, Step: 72
2023-04-14 21:49:51 - r - INFO: - Episode: 111/2000, Reward: -15.122, Step: 300
2023-04-14 21:49:53 - r - INFO: - Episode: 112/2000, Reward: -128.649, Step: 101
2023-04-14 21:49:59 - r - INFO: - Episode: 113/2000, Reward: -20.965, Step: 300
2023-04-14 21:50:05 - r - INFO: - Episode: 114/2000, Reward: -19.886, Step: 300
2023-04-14 21:50:06 - r - INFO: - Episode: 115/2000, Reward: -114.630, Step: 73
2023-04-14 21:50:13 - r - INFO: - Episode: 116/2000, Reward: -28.694, Step: 300
2023-04-14 21:50:19 - r - INFO: - Episode: 117/2000, Reward: -22.584, Step: 300
2023-04-14 21:50:26 - r - INFO: - Episode: 118/2000, Reward: -25.956, Step: 300
2023-04-14 21:50:32 - r - INFO: - Episode: 119/2000, Reward: -26.005, Step: 300
2023-04-14 21:50:38 - r - INFO: - Episode: 120/2000, Reward: -20.102, Step: 300
2023-04-14 21:50:43 - r - INFO: - Current episode 120 has the best eval reward: -20.415
2023-04-14 21:50:49 - r - INFO: - Episode: 121/2000, Reward: -15.634, Step: 300
2023-04-14 21:50:55 - r - INFO: - Episode: 122/2000, Reward: -18.242, Step: 300
2023-04-14 21:51:01 - r - INFO: - Episode: 123/2000, Reward: -12.302, Step: 300
2023-04-14 21:51:06 - r - INFO: - Episode: 124/2000, Reward: -115.354, Step: 281
2023-04-14 21:51:12 - r - INFO: - Episode: 125/2000, Reward: -16.132, Step: 300
2023-04-14 21:51:18 - r - INFO: - Episode: 126/2000, Reward: -12.939, Step: 300
2023-04-14 21:51:26 - r - INFO: - Episode: 127/2000, Reward: -17.105, Step: 300
2023-04-14 21:51:34 - r - INFO: - Episode: 128/2000, Reward: -22.028, Step: 300
2023-04-14 21:51:35 - r - INFO: - Episode: 129/2000, Reward: -111.802, Step: 53
2023-04-14 21:51:40 - r - INFO: - Episode: 130/2000, Reward: -12.520, Step: 300
2023-04-14 21:51:48 - r - INFO: - Episode: 131/2000, Reward: -13.983, Step: 300
2023-04-14 21:51:49 - r - INFO: - Episode: 132/2000, Reward: -112.494, Step: 48
2023-04-14 21:52:03 - r - INFO: - Episode: 133/2000, Reward: -16.831, Step: 300
2023-04-14 21:52:20 - r - INFO: - Episode: 134/2000, Reward: -17.937, Step: 300
2023-04-14 21:52:33 - r - INFO: - Episode: 135/2000, Reward: -13.942, Step: 300
2023-04-14 21:52:34 - r - INFO: - Episode: 136/2000, Reward: -109.476, Step: 40
2023-04-14 21:52:44 - r - INFO: - Episode: 137/2000, Reward: -20.929, Step: 300
2023-04-14 21:52:51 - r - INFO: - Episode: 138/2000, Reward: -104.726, Step: 126
2023-04-14 21:52:58 - r - INFO: - Episode: 139/2000, Reward: -102.115, Step: 138
2023-04-14 21:53:01 - r - INFO: - Episode: 140/2000, Reward: -107.004, Step: 67
2023-04-14 21:53:13 - r - INFO: - Current episode 140 has the best eval reward: -12.785
2023-04-14 21:53:24 - r - INFO: - Episode: 141/2000, Reward: -17.928, Step: 300
2023-04-14 21:53:29 - r - INFO: - Episode: 142/2000, Reward: -111.173, Step: 147
2023-04-14 21:53:30 - r - INFO: - Episode: 143/2000, Reward: -106.466, Step: 48
2023-04-14 21:53:32 - r - INFO: - Episode: 144/2000, Reward: -116.868, Step: 51
2023-04-14 21:53:45 - r - INFO: - Episode: 145/2000, Reward: -12.773, Step: 300
2023-04-14 21:53:50 - r - INFO: - Episode: 146/2000, Reward: -106.853, Step: 162
2023-04-14 21:53:59 - r - INFO: - Episode: 147/2000, Reward: -131.277, Step: 175
2023-04-14 21:54:03 - r - INFO: - Episode: 148/2000, Reward: -106.481, Step: 80
2023-04-14 21:54:15 - r - INFO: - Episode: 149/2000, Reward: -20.066, Step: 300
2023-04-14 21:54:18 - r - INFO: - Episode: 150/2000, Reward: -104.687, Step: 151
2023-04-14 21:54:20 - r - INFO: - Episode: 151/2000, Reward: -107.593, Step: 62
2023-04-14 21:54:27 - r - INFO: - Episode: 152/2000, Reward: -19.555, Step: 300
2023-04-14 21:54:34 - r - INFO: - Episode: 153/2000, Reward: -23.645, Step: 300
2023-04-14 21:54:43 - r - INFO: - Episode: 154/2000, Reward: -12.603, Step: 300
2023-04-14 21:54:52 - r - INFO: - Episode: 155/2000, Reward: -19.999, Step: 300
2023-04-14 21:55:00 - r - INFO: - Episode: 156/2000, Reward: -13.257, Step: 300
2023-04-14 21:55:07 - r - INFO: - Episode: 157/2000, Reward: -110.936, Step: 249
2023-04-14 21:55:14 - r - INFO: - Episode: 158/2000, Reward: -16.879, Step: 300
2023-04-14 21:55:22 - r - INFO: - Episode: 159/2000, Reward: -15.017, Step: 300
2023-04-14 21:55:30 - r - INFO: - Episode: 160/2000, Reward: -25.627, Step: 300
2023-04-14 21:55:46 - r - INFO: - Episode: 161/2000, Reward: -16.128, Step: 300
2023-04-14 21:55:54 - r - INFO: - Episode: 162/2000, Reward: -14.815, Step: 300
2023-04-14 21:55:59 - r - INFO: - Episode: 163/2000, Reward: -112.886, Step: 221
2023-04-14 21:56:07 - r - INFO: - Episode: 164/2000, Reward: -19.762, Step: 300
2023-04-14 21:56:15 - r - INFO: - Episode: 165/2000, Reward: -24.051, Step: 300
2023-04-14 21:56:23 - r - INFO: - Episode: 166/2000, Reward: -17.533, Step: 300
2023-04-14 21:56:30 - r - INFO: - Episode: 167/2000, Reward: -14.292, Step: 300
2023-04-14 21:56:38 - r - INFO: - Episode: 168/2000, Reward: -13.066, Step: 300
2023-04-14 21:56:46 - r - INFO: - Episode: 169/2000, Reward: -8.492, Step: 300
2023-04-14 21:56:55 - r - INFO: - Episode: 170/2000, Reward: -11.667, Step: 300
2023-04-14 21:57:03 - r - INFO: - Episode: 171/2000, Reward: -17.485, Step: 300
2023-04-14 21:57:12 - r - INFO: - Episode: 172/2000, Reward: -18.128, Step: 300
2023-04-14 21:57:21 - r - INFO: - Episode: 173/2000, Reward: -13.669, Step: 300
2023-04-14 21:57:31 - r - INFO: - Episode: 174/2000, Reward: -8.722, Step: 300
2023-04-14 21:57:38 - r - INFO: - Episode: 175/2000, Reward: -16.476, Step: 300
2023-04-14 21:57:46 - r - INFO: - Episode: 176/2000, Reward: -6.403, Step: 300
2023-04-14 21:57:52 - r - INFO: - Episode: 177/2000, Reward: -100.833, Step: 200
2023-04-14 21:57:55 - r - INFO: - Episode: 178/2000, Reward: -132.506, Step: 104
2023-04-14 21:57:58 - r - INFO: - Episode: 179/2000, Reward: -98.940, Step: 84
2023-04-14 21:58:00 - r - INFO: - Episode: 180/2000, Reward: -101.245, Step: 69
2023-04-14 21:58:03 - r - INFO: - Episode: 181/2000, Reward: -100.234, Step: 80
2023-04-14 21:58:06 - r - INFO: - Episode: 182/2000, Reward: -107.108, Step: 117
2023-04-14 21:58:08 - r - INFO: - Episode: 183/2000, Reward: -99.627, Step: 59
2023-04-14 21:58:10 - r - INFO: - Episode: 184/2000, Reward: -99.011, Step: 80
2023-04-14 21:58:13 - r - INFO: - Episode: 185/2000, Reward: -118.452, Step: 53
2023-04-14 21:58:16 - r - INFO: - Episode: 186/2000, Reward: -136.912, Step: 123
2023-04-14 21:58:20 - r - INFO: - Episode: 187/2000, Reward: -140.037, Step: 175
2023-04-14 21:58:22 - r - INFO: - Episode: 188/2000, Reward: -101.002, Step: 94
2023-04-14 21:58:24 - r - INFO: - Episode: 189/2000, Reward: -123.934, Step: 81
2023-04-14 21:58:26 - r - INFO: - Episode: 190/2000, Reward: -108.270, Step: 72
2023-04-14 21:58:28 - r - INFO: - Episode: 191/2000, Reward: -103.413, Step: 79
2023-04-14 21:58:29 - r - INFO: - Episode: 192/2000, Reward: -102.722, Step: 61
2023-04-14 21:58:33 - r - INFO: - Episode: 193/2000, Reward: -105.449, Step: 133
2023-04-14 21:58:34 - r - INFO: - Episode: 194/2000, Reward: -103.778, Step: 52
2023-04-14 21:58:38 - r - INFO: - Episode: 195/2000, Reward: -141.932, Step: 162
2023-04-14 21:58:40 - r - INFO: - Episode: 196/2000, Reward: -101.548, Step: 86
2023-04-14 21:58:42 - r - INFO: - Episode: 197/2000, Reward: -103.067, Step: 64
2023-04-14 21:58:44 - r - INFO: - Episode: 198/2000, Reward: -101.696, Step: 84
2023-04-14 21:58:47 - r - INFO: - Episode: 199/2000, Reward: -103.446, Step: 113
2023-04-14 21:58:50 - r - INFO: - Episode: 200/2000, Reward: -124.965, Step: 106
2023-04-14 21:58:53 - r - INFO: - Episode: 201/2000, Reward: -108.299, Step: 88
2023-04-14 21:58:55 - r - INFO: - Episode: 202/2000, Reward: -126.026, Step: 90
2023-04-14 21:58:57 - r - INFO: - Episode: 203/2000, Reward: -103.314, Step: 51
2023-04-14 21:58:58 - r - INFO: - Episode: 204/2000, Reward: -124.904, Step: 76
2023-04-14 21:59:01 - r - INFO: - Episode: 205/2000, Reward: -124.513, Step: 99
2023-04-14 21:59:02 - r - INFO: - Episode: 206/2000, Reward: -125.793, Step: 59
2023-04-14 21:59:04 - r - INFO: - Episode: 207/2000, Reward: -124.365, Step: 56
2023-04-14 21:59:05 - r - INFO: - Episode: 208/2000, Reward: -120.568, Step: 74
2023-04-14 21:59:07 - r - INFO: - Episode: 209/2000, Reward: -126.892, Step: 61
2023-04-14 21:59:10 - r - INFO: - Episode: 210/2000, Reward: -135.588, Step: 128
2023-04-14 21:59:12 - r - INFO: - Episode: 211/2000, Reward: -128.087, Step: 71
2023-04-14 21:59:14 - r - INFO: - Episode: 212/2000, Reward: -130.150, Step: 105
2023-04-14 21:59:16 - r - INFO: - Episode: 213/2000, Reward: -124.440, Step: 70
2023-04-14 21:59:23 - r - INFO: - Episode: 214/2000, Reward: -27.892, Step: 300
2023-04-14 21:59:30 - r - INFO: - Episode: 215/2000, Reward: -26.541, Step: 300
2023-04-14 21:59:32 - r - INFO: - Episode: 216/2000, Reward: -123.667, Step: 86
2023-04-14 21:59:39 - r - INFO: - Episode: 217/2000, Reward: -37.209, Step: 300
2023-04-14 21:59:47 - r - INFO: - Episode: 218/2000, Reward: -14.759, Step: 300
2023-04-14 21:59:55 - r - INFO: - Episode: 219/2000, Reward: -20.737, Step: 300
2023-04-14 22:00:02 - r - INFO: - Episode: 220/2000, Reward: -29.673, Step: 300
2023-04-14 22:00:16 - r - INFO: - Episode: 221/2000, Reward: -33.928, Step: 300
2023-04-14 22:00:28 - r - INFO: - Episode: 222/2000, Reward: -23.773, Step: 300
2023-04-14 22:00:35 - r - INFO: - Episode: 223/2000, Reward: -26.535, Step: 300
2023-04-14 22:00:42 - r - INFO: - Episode: 224/2000, Reward: -26.489, Step: 300
2023-04-14 22:00:44 - r - INFO: - Episode: 225/2000, Reward: -113.939, Step: 118
2023-04-14 22:00:50 - r - INFO: - Episode: 226/2000, Reward: -114.985, Step: 261
2023-04-14 22:00:55 - r - INFO: - Episode: 227/2000, Reward: -109.480, Step: 203
2023-04-14 22:01:00 - r - INFO: - Episode: 228/2000, Reward: -104.623, Step: 160
2023-04-14 22:01:02 - r - INFO: - Episode: 229/2000, Reward: -114.187, Step: 102
2023-04-14 22:01:04 - r - INFO: - Episode: 230/2000, Reward: -104.979, Step: 123
2023-04-14 22:01:08 - r - INFO: - Episode: 231/2000, Reward: -107.174, Step: 151
2023-04-14 22:01:12 - r - INFO: - Episode: 232/2000, Reward: -110.844, Step: 115
2023-04-14 22:01:15 - r - INFO: - Episode: 233/2000, Reward: -108.186, Step: 150
2023-04-14 22:01:20 - r - INFO: - Episode: 234/2000, Reward: -114.269, Step: 128
2023-04-14 22:01:22 - r - INFO: - Episode: 235/2000, Reward: -122.510, Step: 98
2023-04-14 22:01:25 - r - INFO: - Episode: 236/2000, Reward: -112.232, Step: 114
2023-04-14 22:01:30 - r - INFO: - Episode: 237/2000, Reward: -104.013, Step: 113
2023-04-14 22:01:35 - r - INFO: - Episode: 238/2000, Reward: -113.432, Step: 123
2023-04-14 22:01:40 - r - INFO: - Episode: 239/2000, Reward: -104.170, Step: 134
2023-04-14 22:01:47 - r - INFO: - Episode: 240/2000, Reward: -108.710, Step: 147
2023-04-14 22:01:59 - r - INFO: - Episode: 241/2000, Reward: -108.712, Step: 157
2023-04-14 22:02:06 - r - INFO: - Episode: 242/2000, Reward: -105.903, Step: 176
2023-04-14 22:02:16 - r - INFO: - Episode: 243/2000, Reward: -5.803, Step: 300
2023-04-14 22:02:23 - r - INFO: - Episode: 244/2000, Reward: -118.068, Step: 288
2023-04-14 22:02:25 - r - INFO: - Episode: 245/2000, Reward: -106.936, Step: 115
2023-04-14 22:02:34 - r - INFO: - Episode: 246/2000, Reward: -108.424, Step: 296
2023-04-14 22:02:44 - r - INFO: - Episode: 247/2000, Reward: -16.543, Step: 300
2023-04-14 22:02:52 - r - INFO: - Episode: 248/2000, Reward: -16.007, Step: 300
2023-04-14 22:03:03 - r - INFO: - Episode: 249/2000, Reward: -25.237, Step: 300
2023-04-14 22:03:12 - r - INFO: - Episode: 250/2000, Reward: -26.478, Step: 300
2023-04-14 22:03:23 - r - INFO: - Episode: 251/2000, Reward: -26.722, Step: 300
2023-04-14 22:03:30 - r - INFO: - Episode: 252/2000, Reward: -19.996, Step: 300
2023-04-14 22:03:38 - r - INFO: - Episode: 253/2000, Reward: -38.016, Step: 300
2023-04-14 22:03:45 - r - INFO: - Episode: 254/2000, Reward: -141.589, Step: 273
2023-04-14 22:03:50 - r - INFO: - Episode: 255/2000, Reward: -106.863, Step: 195
2023-04-14 22:03:52 - r - INFO: - Episode: 256/2000, Reward: -100.874, Step: 77
2023-04-14 22:03:54 - r - INFO: - Episode: 257/2000, Reward: -99.885, Step: 75
2023-04-14 22:03:57 - r - INFO: - Episode: 258/2000, Reward: -100.532, Step: 102
2023-04-14 22:04:06 - r - INFO: - Episode: 259/2000, Reward: -28.615, Step: 300
2023-04-14 22:04:14 - r - INFO: - Episode: 260/2000, Reward: -9.074, Step: 300
2023-04-14 22:04:20 - r - INFO: - Episode: 261/2000, Reward: -110.718, Step: 61
2023-04-14 22:04:24 - r - INFO: - Episode: 262/2000, Reward: -101.965, Step: 144
2023-04-14 22:04:27 - r - INFO: - Episode: 263/2000, Reward: -107.552, Step: 75
2023-04-14 22:04:28 - r - INFO: - Episode: 264/2000, Reward: -99.243, Step: 64
2023-04-14 22:04:30 - r - INFO: - Episode: 265/2000, Reward: -111.676, Step: 60
2023-04-14 22:04:34 - r - INFO: - Episode: 266/2000, Reward: -95.963, Step: 183
2023-04-14 22:04:42 - r - INFO: - Episode: 267/2000, Reward: -7.738, Step: 300
2023-04-14 22:04:43 - r - INFO: - Episode: 268/2000, Reward: -111.072, Step: 58
2023-04-14 22:04:45 - r - INFO: - Episode: 269/2000, Reward: -122.073, Step: 78
2023-04-14 22:04:48 - r - INFO: - Episode: 270/2000, Reward: -128.796, Step: 118
2023-04-14 22:04:56 - r - INFO: - Episode: 271/2000, Reward: -10.651, Step: 300
2023-04-14 22:05:05 - r - INFO: - Episode: 272/2000, Reward: -18.478, Step: 300
2023-04-14 22:05:07 - r - INFO: - Episode: 273/2000, Reward: -107.653, Step: 75
2023-04-14 22:05:16 - r - INFO: - Episode: 274/2000, Reward: -13.718, Step: 300
2023-04-14 22:05:17 - r - INFO: - Episode: 275/2000, Reward: -102.534, Step: 62
2023-04-14 22:05:20 - r - INFO: - Episode: 276/2000, Reward: -104.850, Step: 94
2023-04-14 22:05:22 - r - INFO: - Episode: 277/2000, Reward: -104.585, Step: 74
2023-04-14 22:05:30 - r - INFO: - Episode: 278/2000, Reward: -20.520, Step: 300
2023-04-14 22:05:39 - r - INFO: - Episode: 279/2000, Reward: -25.098, Step: 300
2023-04-14 22:05:47 - r - INFO: - Episode: 280/2000, Reward: -31.482, Step: 300
2023-04-14 22:06:02 - r - INFO: - Episode: 281/2000, Reward: -25.983, Step: 300
2023-04-14 22:06:11 - r - INFO: - Episode: 282/2000, Reward: -18.615, Step: 300
2023-04-14 22:06:19 - r - INFO: - Episode: 283/2000, Reward: -21.484, Step: 300
2023-04-14 22:06:28 - r - INFO: - Episode: 284/2000, Reward: -18.972, Step: 300
2023-04-14 22:06:31 - r - INFO: - Episode: 285/2000, Reward: -100.927, Step: 92
2023-04-14 22:06:40 - r - INFO: - Episode: 286/2000, Reward: -26.809, Step: 300
2023-04-14 22:06:49 - r - INFO: - Episode: 287/2000, Reward: -25.908, Step: 300
2023-04-14 22:06:58 - r - INFO: - Episode: 288/2000, Reward: -24.729, Step: 300
2023-04-14 22:07:07 - r - INFO: - Episode: 289/2000, Reward: -25.593, Step: 300
2023-04-14 22:07:15 - r - INFO: - Episode: 290/2000, Reward: -21.192, Step: 300
2023-04-14 22:07:17 - r - INFO: - Episode: 291/2000, Reward: -100.526, Step: 76
2023-04-14 22:07:26 - r - INFO: - Episode: 292/2000, Reward: -29.540, Step: 300
2023-04-14 22:07:34 - r - INFO: - Episode: 293/2000, Reward: -23.734, Step: 300
2023-04-14 22:07:42 - r - INFO: - Episode: 294/2000, Reward: -38.095, Step: 300
2023-04-14 22:07:43 - r - INFO: - Episode: 295/2000, Reward: -115.290, Step: 46
2023-04-14 22:07:50 - r - INFO: - Episode: 296/2000, Reward: -23.177, Step: 300
2023-04-14 22:07:53 - r - INFO: - Episode: 297/2000, Reward: -113.365, Step: 101
2023-04-14 22:07:58 - r - INFO: - Episode: 298/2000, Reward: -118.093, Step: 196
2023-04-14 22:08:03 - r - INFO: - Episode: 299/2000, Reward: -142.048, Step: 190
2023-04-14 22:08:06 - r - INFO: - Episode: 300/2000, Reward: -112.208, Step: 122
2023-04-14 22:08:15 - r - INFO: - Episode: 301/2000, Reward: -114.126, Step: 109
2023-04-14 22:08:17 - r - INFO: - Episode: 302/2000, Reward: -112.334, Step: 111
2023-04-14 22:08:25 - r - INFO: - Episode: 303/2000, Reward: -26.616, Step: 300
2023-04-14 22:08:33 - r - INFO: - Episode: 304/2000, Reward: -6.406, Step: 300
2023-04-14 22:08:37 - r - INFO: - Episode: 305/2000, Reward: -115.125, Step: 172
2023-04-14 22:08:40 - r - INFO: - Episode: 306/2000, Reward: -133.177, Step: 130
2023-04-14 22:08:48 - r - INFO: - Episode: 307/2000, Reward: -21.432, Step: 300
2023-04-14 22:08:52 - r - INFO: - Episode: 308/2000, Reward: -106.487, Step: 161
2023-04-14 22:08:57 - r - INFO: - Episode: 309/2000, Reward: -108.145, Step: 184
2023-04-14 22:09:04 - r - INFO: - Episode: 310/2000, Reward: -13.788, Step: 300
2023-04-14 22:09:08 - r - INFO: - Episode: 311/2000, Reward: -109.357, Step: 165
2023-04-14 22:09:16 - r - INFO: - Episode: 312/2000, Reward: -14.325, Step: 300
2023-04-14 22:09:20 - r - INFO: - Episode: 313/2000, Reward: -107.740, Step: 141
2023-04-14 22:09:28 - r - INFO: - Episode: 314/2000, Reward: -19.355, Step: 300
2023-04-14 22:09:35 - r - INFO: - Episode: 315/2000, Reward: -11.451, Step: 300
2023-04-14 22:09:42 - r - INFO: - Episode: 316/2000, Reward: -17.650, Step: 300
2023-04-14 22:09:47 - r - INFO: - Episode: 317/2000, Reward: -118.744, Step: 142
2023-04-14 22:09:54 - r - INFO: - Episode: 318/2000, Reward: -41.644, Step: 300
2023-04-14 22:10:01 - r - INFO: - Episode: 319/2000, Reward: -126.153, Step: 250
2023-04-14 22:10:08 - r - INFO: - Episode: 320/2000, Reward: -105.399, Step: 242
2023-04-14 22:10:19 - r - INFO: - Episode: 321/2000, Reward: -100.893, Step: 257
2023-04-14 22:10:26 - r - INFO: - Episode: 322/2000, Reward: -111.042, Step: 252
2023-04-14 22:10:30 - r - INFO: - Episode: 323/2000, Reward: -106.812, Step: 159
2023-04-14 22:10:37 - r - INFO: - Episode: 324/2000, Reward: -7.826, Step: 300
2023-04-14 22:10:45 - r - INFO: - Episode: 325/2000, Reward: -37.343, Step: 300
2023-04-14 22:10:46 - r - INFO: - Episode: 326/2000, Reward: -121.399, Step: 67
2023-04-14 22:10:50 - r - INFO: - Episode: 327/2000, Reward: -107.256, Step: 148
2023-04-14 22:10:53 - r - INFO: - Episode: 328/2000, Reward: -108.018, Step: 135
2023-04-14 22:10:56 - r - INFO: - Episode: 329/2000, Reward: -126.524, Step: 121
2023-04-14 22:10:58 - r - INFO: - Episode: 330/2000, Reward: -117.286, Step: 84
2023-04-14 22:11:01 - r - INFO: - Episode: 331/2000, Reward: -99.335, Step: 114
2023-04-14 22:11:06 - r - INFO: - Episode: 332/2000, Reward: -128.469, Step: 167
2023-04-14 22:11:09 - r - INFO: - Episode: 333/2000, Reward: -125.342, Step: 117
2023-04-14 22:11:10 - r - INFO: - Episode: 334/2000, Reward: -101.527, Step: 63
2023-04-14 22:11:17 - r - INFO: - Episode: 335/2000, Reward: -102.121, Step: 183
2023-04-14 22:11:21 - r - INFO: - Episode: 336/2000, Reward: -106.517, Step: 130
2023-04-14 22:11:24 - r - INFO: - Episode: 337/2000, Reward: -104.048, Step: 105
2023-04-14 22:11:27 - r - INFO: - Episode: 338/2000, Reward: -105.707, Step: 130
2023-04-14 22:11:30 - r - INFO: - Episode: 339/2000, Reward: -103.940, Step: 94
2023-04-14 22:11:36 - r - INFO: - Episode: 340/2000, Reward: -100.597, Step: 235
2023-04-14 22:11:44 - r - INFO: - Episode: 341/2000, Reward: -111.749, Step: 185
2023-04-14 22:11:47 - r - INFO: - Episode: 342/2000, Reward: -102.824, Step: 139
2023-04-14 22:11:59 - r - INFO: - Episode: 343/2000, Reward: 4.364, Step: 300
2023-04-14 22:12:01 - r - INFO: - Episode: 344/2000, Reward: -105.986, Step: 92
2023-04-14 22:12:11 - r - INFO: - Episode: 345/2000, Reward: -0.487, Step: 300
2023-04-14 22:12:23 - r - INFO: - Episode: 346/2000, Reward: -23.065, Step: 300
2023-04-14 22:12:31 - r - INFO: - Episode: 347/2000, Reward: -28.013, Step: 300
2023-04-14 22:12:35 - r - INFO: - Episode: 348/2000, Reward: -103.631, Step: 148
2023-04-14 22:12:39 - r - INFO: - Episode: 349/2000, Reward: -93.968, Step: 137
2023-04-14 22:12:45 - r - INFO: - Episode: 350/2000, Reward: -1.300, Step: 300
2023-04-14 22:12:48 - r - INFO: - Episode: 351/2000, Reward: -105.389, Step: 139
2023-04-14 22:12:51 - r - INFO: - Episode: 352/2000, Reward: -108.773, Step: 147
2023-04-14 22:12:58 - r - INFO: - Episode: 353/2000, Reward: -0.373, Step: 300
2023-04-14 22:13:06 - r - INFO: - Episode: 354/2000, Reward: 8.801, Step: 300
2023-04-14 22:13:12 - r - INFO: - Episode: 355/2000, Reward: -95.032, Step: 241
2023-04-14 22:13:19 - r - INFO: - Episode: 356/2000, Reward: -2.565, Step: 300
2023-04-14 22:13:25 - r - INFO: - Episode: 357/2000, Reward: 8.099, Step: 300
2023-04-14 22:15:23 - r - INFO: - Episode: 358/2000, Reward: -107.432, Step: 120
2023-04-14 22:16:29 - r - INFO: - Episode: 359/2000, Reward: -101.845, Step: 149
2023-04-14 22:16:35 - r - INFO: - Episode: 360/2000, Reward: 18.248, Step: 300
2023-04-14 22:16:41 - r - INFO: - Current episode 360 has the best eval reward: 9.623
2023-04-14 22:17:10 - r - INFO: - Episode: 361/2000, Reward: -98.748, Step: 99
2023-04-14 22:17:15 - r - INFO: - Episode: 362/2000, Reward: -95.939, Step: 196
2023-04-14 22:17:17 - r - INFO: - Episode: 363/2000, Reward: -106.797, Step: 91
2023-04-14 22:17:24 - r - INFO: - Episode: 364/2000, Reward: -89.971, Step: 300
2023-04-14 22:17:27 - r - INFO: - Episode: 365/2000, Reward: -100.816, Step: 118
2023-04-14 22:17:34 - r - INFO: - Episode: 366/2000, Reward: -24.075, Step: 300
2023-04-14 22:17:40 - r - INFO: - Episode: 367/2000, Reward: -106.835, Step: 83
2023-04-14 22:18:18 - r - INFO: - Episode: 368/2000, Reward: 8.414, Step: 300
2023-04-14 22:18:21 - r - INFO: - Episode: 369/2000, Reward: -103.143, Step: 101
2023-04-14 22:18:27 - r - INFO: - Episode: 370/2000, Reward: -87.694, Step: 139
2023-04-14 22:18:52 - r - INFO: - Episode: 371/2000, Reward: -96.281, Step: 190
2023-04-14 22:19:03 - r - INFO: - Episode: 372/2000, Reward: -6.461, Step: 300
2023-04-14 22:19:06 - r - INFO: - Episode: 373/2000, Reward: -112.144, Step: 115
2023-04-14 22:19:11 - r - INFO: - Episode: 374/2000, Reward: -91.016, Step: 182
2023-04-14 22:19:13 - r - INFO: - Episode: 375/2000, Reward: -107.397, Step: 60
2023-04-14 22:19:17 - r - INFO: - Episode: 376/2000, Reward: -95.471, Step: 189
2023-04-14 22:19:19 - r - INFO: - Episode: 377/2000, Reward: -103.090, Step: 67
2023-04-14 22:19:21 - r - INFO: - Episode: 378/2000, Reward: -107.553, Step: 119
2023-04-14 22:19:26 - r - INFO: - Episode: 379/2000, Reward: -88.947, Step: 196
2023-04-14 22:19:30 - r - INFO: - Episode: 380/2000, Reward: -99.564, Step: 193
2023-04-14 22:19:37 - r - INFO: - Episode: 381/2000, Reward: -107.201, Step: 99
2023-04-14 22:19:44 - r - INFO: - Episode: 382/2000, Reward: -11.114, Step: 300
2023-04-14 22:19:49 - r - INFO: - Episode: 383/2000, Reward: -102.629, Step: 218
2023-04-14 22:19:56 - r - INFO: - Episode: 384/2000, Reward: -15.805, Step: 300
2023-04-14 22:19:59 - r - INFO: - Episode: 385/2000, Reward: -122.989, Step: 72
2023-04-14 22:20:05 - r - INFO: - Episode: 386/2000, Reward: -99.103, Step: 146
2023-04-14 22:20:09 - r - INFO: - Episode: 387/2000, Reward: -97.800, Step: 99
2023-04-14 22:20:12 - r - INFO: - Episode: 388/2000, Reward: -122.384, Step: 78
2023-04-14 22:20:14 - r - INFO: - Episode: 389/2000, Reward: -127.850, Step: 83
2023-04-14 22:20:16 - r - INFO: - Episode: 390/2000, Reward: -123.968, Step: 73
2023-04-14 22:20:20 - r - INFO: - Episode: 391/2000, Reward: -96.547, Step: 166
2023-04-14 22:20:23 - r - INFO: - Episode: 392/2000, Reward: -100.428, Step: 106
2023-04-14 22:20:39 - r - INFO: - Episode: 393/2000, Reward: -88.349, Step: 224
2023-04-14 22:20:42 - r - INFO: - Episode: 394/2000, Reward: -96.914, Step: 104
2023-04-14 22:20:47 - r - INFO: - Episode: 395/2000, Reward: -97.018, Step: 184
2023-04-14 22:20:54 - r - INFO: - Episode: 396/2000, Reward: -22.148, Step: 300
2023-04-14 22:20:55 - r - INFO: - Episode: 397/2000, Reward: -101.655, Step: 51
2023-04-14 22:21:03 - r - INFO: - Episode: 398/2000, Reward: -30.572, Step: 300
2023-04-14 22:21:09 - r - INFO: - Episode: 399/2000, Reward: -89.325, Step: 230
2023-04-14 22:21:17 - r - INFO: - Episode: 400/2000, Reward: -24.982, Step: 300
2023-04-14 22:21:26 - r - INFO: - Episode: 401/2000, Reward: -35.876, Step: 300
2023-04-14 22:21:27 - r - INFO: - Episode: 402/2000, Reward: -103.959, Step: 56
2023-04-14 22:21:35 - r - INFO: - Episode: 403/2000, Reward: -20.680, Step: 300
2023-04-14 22:21:45 - r - INFO: - Episode: 404/2000, Reward: -29.679, Step: 300
2023-04-14 22:21:53 - r - INFO: - Episode: 405/2000, Reward: -14.902, Step: 300
2023-04-14 22:22:01 - r - INFO: - Episode: 406/2000, Reward: -16.149, Step: 300
2023-04-14 22:22:08 - r - INFO: - Episode: 407/2000, Reward: -29.861, Step: 300
2023-04-14 22:22:15 - r - INFO: - Episode: 408/2000, Reward: 2.079, Step: 300
2023-04-14 22:22:21 - r - INFO: - Episode: 409/2000, Reward: -90.663, Step: 233
2023-04-14 22:22:28 - r - INFO: - Episode: 410/2000, Reward: -31.267, Step: 300
2023-04-14 22:22:35 - r - INFO: - Episode: 411/2000, Reward: 7.243, Step: 300
2023-04-14 22:22:38 - r - INFO: - Episode: 412/2000, Reward: -113.023, Step: 114
2023-04-14 22:22:46 - r - INFO: - Episode: 413/2000, Reward: -33.594, Step: 300
2023-04-14 22:22:55 - r - INFO: - Episode: 414/2000, Reward: -32.560, Step: 300
2023-04-14 22:22:57 - r - INFO: - Episode: 415/2000, Reward: -116.987, Step: 71
2023-04-14 22:23:06 - r - INFO: - Episode: 416/2000, Reward: -27.541, Step: 300
2023-04-14 22:23:13 - r - INFO: - Episode: 417/2000, Reward: 8.136, Step: 300
2023-04-14 22:23:19 - r - INFO: - Episode: 418/2000, Reward: -100.190, Step: 239
2023-04-14 22:23:31 - r - INFO: - Episode: 419/2000, Reward: 5.091, Step: 300
2023-04-14 22:23:42 - r - INFO: - Episode: 420/2000, Reward: -24.965, Step: 300
2023-04-14 22:23:56 - r - INFO: - Episode: 421/2000, Reward: -30.805, Step: 300
2023-04-14 22:24:00 - r - INFO: - Episode: 422/2000, Reward: -129.883, Step: 131
2023-04-14 22:24:08 - r - INFO: - Episode: 423/2000, Reward: -17.671, Step: 300
2023-04-14 22:24:16 - r - INFO: - Episode: 424/2000, Reward: -32.110, Step: 300
2023-04-14 22:24:24 - r - INFO: - Episode: 425/2000, Reward: 9.918, Step: 300
2023-04-14 22:24:31 - r - INFO: - Episode: 426/2000, Reward: -2.897, Step: 300
2023-04-14 22:24:38 - r - INFO: - Episode: 427/2000, Reward: -38.354, Step: 300
2023-04-14 22:24:45 - r - INFO: - Episode: 428/2000, Reward: -88.929, Step: 245
2023-04-14 22:24:52 - r - INFO: - Episode: 429/2000, Reward: -84.612, Step: 254
2023-04-14 22:24:59 - r - INFO: - Episode: 430/2000, Reward: 21.768, Step: 300
2023-04-14 22:25:06 - r - INFO: - Episode: 431/2000, Reward: -104.165, Step: 259
2023-04-14 22:25:17 - r - INFO: - Episode: 432/2000, Reward: 20.208, Step: 300
2023-04-14 22:25:27 - r - INFO: - Episode: 433/2000, Reward: -28.827, Step: 300
2023-04-14 22:25:31 - r - INFO: - Episode: 434/2000, Reward: -113.642, Step: 126
2023-04-14 22:25:32 - r - INFO: - Episode: 435/2000, Reward: -107.973, Step: 47
2023-04-14 22:25:35 - r - INFO: - Episode: 436/2000, Reward: -95.109, Step: 123
2023-04-14 22:25:39 - r - INFO: - Episode: 437/2000, Reward: -119.975, Step: 137
2023-04-14 22:25:45 - r - INFO: - Episode: 438/2000, Reward: -77.773, Step: 188
2023-04-14 22:25:54 - r - INFO: - Episode: 439/2000, Reward: -22.616, Step: 300
2023-04-14 22:25:59 - r - INFO: - Episode: 440/2000, Reward: -123.255, Step: 203
2023-04-14 22:26:04 - r - INFO: - Current episode 440 has the best eval reward: 22.200
2023-04-14 22:26:12 - r - INFO: - Episode: 441/2000, Reward: 9.308, Step: 300
2023-04-14 22:26:15 - r - INFO: - Episode: 442/2000, Reward: -105.124, Step: 130
2023-04-14 22:26:19 - r - INFO: - Episode: 443/2000, Reward: -116.231, Step: 152
2023-04-14 22:26:22 - r - INFO: - Episode: 444/2000, Reward: -83.744, Step: 159
2023-04-14 22:26:30 - r - INFO: - Episode: 445/2000, Reward: -15.606, Step: 300
2023-04-14 22:26:33 - r - INFO: - Episode: 446/2000, Reward: -99.108, Step: 144
2023-04-14 22:26:42 - r - INFO: - Episode: 447/2000, Reward: 2.313, Step: 300
2023-04-14 22:26:49 - r - INFO: - Episode: 448/2000, Reward: 27.423, Step: 300
2023-04-14 22:26:55 - r - INFO: - Episode: 449/2000, Reward: -76.635, Step: 201
2023-04-14 22:27:04 - r - INFO: - Episode: 450/2000, Reward: -23.147, Step: 300
2023-04-14 22:27:14 - r - INFO: - Episode: 451/2000, Reward: 15.336, Step: 300
2023-04-14 22:27:23 - r - INFO: - Episode: 452/2000, Reward: 16.753, Step: 300
2023-04-14 22:27:31 - r - INFO: - Episode: 453/2000, Reward: 13.257, Step: 300
2023-04-14 22:27:38 - r - INFO: - Episode: 454/2000, Reward: -96.749, Step: 181
2023-04-14 22:27:40 - r - INFO: - Episode: 455/2000, Reward: -105.633, Step: 64
2023-04-14 22:27:42 - r - INFO: - Episode: 456/2000, Reward: -102.030, Step: 82
2023-04-14 22:27:49 - r - INFO: - Episode: 457/2000, Reward: 4.277, Step: 300
2023-04-14 22:27:57 - r - INFO: - Episode: 458/2000, Reward: 1.738, Step: 300
2023-04-14 22:28:06 - r - INFO: - Episode: 459/2000, Reward: -5.712, Step: 300
2023-04-14 22:28:14 - r - INFO: - Episode: 460/2000, Reward: -18.370, Step: 300
2023-04-14 22:28:27 - r - INFO: - Episode: 461/2000, Reward: -22.801, Step: 300
2023-04-14 22:28:34 - r - INFO: - Episode: 462/2000, Reward: 33.394, Step: 300
2023-04-14 22:28:43 - r - INFO: - Episode: 463/2000, Reward: -13.769, Step: 300
2023-04-14 22:28:47 - r - INFO: - Episode: 464/2000, Reward: -100.123, Step: 133
2023-04-14 22:28:50 - r - INFO: - Episode: 465/2000, Reward: -89.480, Step: 116
2023-04-14 22:28:53 - r - INFO: - Episode: 466/2000, Reward: -89.064, Step: 127
2023-04-14 22:28:55 - r - INFO: - Episode: 467/2000, Reward: -95.629, Step: 108
2023-04-14 22:28:59 - r - INFO: - Episode: 468/2000, Reward: -99.953, Step: 173
2023-04-14 22:29:02 - r - INFO: - Episode: 469/2000, Reward: -95.822, Step: 120
2023-04-14 22:29:05 - r - INFO: - Episode: 470/2000, Reward: -113.192, Step: 167
2023-04-14 22:29:09 - r - INFO: - Episode: 471/2000, Reward: -98.207, Step: 141
2023-04-14 22:29:16 - r - INFO: - Episode: 472/2000, Reward: -113.958, Step: 295
2023-04-14 22:29:20 - r - INFO: - Episode: 473/2000, Reward: -88.162, Step: 151
2023-04-14 22:29:27 - r - INFO: - Episode: 474/2000, Reward: -16.505, Step: 300
2023-04-14 22:29:30 - r - INFO: - Episode: 475/2000, Reward: -93.540, Step: 142
2023-04-14 22:29:32 - r - INFO: - Episode: 476/2000, Reward: -111.651, Step: 85
2023-04-14 22:29:35 - r - INFO: - Episode: 477/2000, Reward: -93.043, Step: 120
2023-04-14 22:29:38 - r - INFO: - Episode: 478/2000, Reward: -96.347, Step: 109
2023-04-14 22:29:42 - r - INFO: - Episode: 479/2000, Reward: -78.850, Step: 187
2023-04-14 22:29:43 - r - INFO: - Episode: 480/2000, Reward: -109.342, Step: 42
2023-04-14 22:29:53 - r - INFO: - Episode: 481/2000, Reward: -63.813, Step: 285
2023-04-14 22:29:55 - r - INFO: - Episode: 482/2000, Reward: -124.407, Step: 68
2023-04-14 22:29:58 - r - INFO: - Episode: 483/2000, Reward: -127.752, Step: 114
2023-04-14 22:30:01 - r - INFO: - Episode: 484/2000, Reward: -87.256, Step: 144
2023-04-14 22:30:04 - r - INFO: - Episode: 485/2000, Reward: -76.895, Step: 144
2023-04-14 22:30:07 - r - INFO: - Episode: 486/2000, Reward: -130.569, Step: 110
2023-04-14 22:30:10 - r - INFO: - Episode: 487/2000, Reward: -128.633, Step: 113
2023-04-14 22:30:11 - r - INFO: - Episode: 488/2000, Reward: -105.620, Step: 52
2023-04-14 22:30:14 - r - INFO: - Episode: 489/2000, Reward: -95.280, Step: 141
2023-04-14 22:30:17 - r - INFO: - Episode: 490/2000, Reward: -122.461, Step: 138
2023-04-14 22:30:19 - r - INFO: - Episode: 491/2000, Reward: -123.629, Step: 77
2023-04-14 22:30:22 - r - INFO: - Episode: 492/2000, Reward: -126.030, Step: 99
2023-04-14 22:30:25 - r - INFO: - Episode: 493/2000, Reward: -116.169, Step: 124
2023-04-14 22:30:31 - r - INFO: - Episode: 494/2000, Reward: -138.274, Step: 265
2023-04-14 22:30:38 - r - INFO: - Episode: 495/2000, Reward: -7.869, Step: 300
2023-04-14 22:30:45 - r - INFO: - Episode: 496/2000, Reward: 4.876, Step: 300
2023-04-14 22:30:52 - r - INFO: - Episode: 497/2000, Reward: -7.278, Step: 300
2023-04-14 22:30:53 - r - INFO: - Episode: 498/2000, Reward: -117.146, Step: 62
2023-04-14 22:31:01 - r - INFO: - Episode: 499/2000, Reward: 15.530, Step: 300
2023-04-14 22:31:08 - r - INFO: - Episode: 500/2000, Reward: 23.718, Step: 300
2023-04-14 22:31:13 - r - INFO: - Current episode 500 has the best eval reward: 29.794
2023-04-14 22:31:20 - r - INFO: - Episode: 501/2000, Reward: 22.247, Step: 300
2023-04-14 22:31:27 - r - INFO: - Episode: 502/2000, Reward: 31.020, Step: 300
2023-04-14 22:31:33 - r - INFO: - Episode: 503/2000, Reward: -84.095, Step: 254
2023-04-14 22:31:36 - r - INFO: - Episode: 504/2000, Reward: -103.550, Step: 80
2023-04-14 22:31:46 - r - INFO: - Episode: 505/2000, Reward: 13.073, Step: 300
2023-04-14 22:31:54 - r - INFO: - Episode: 506/2000, Reward: 44.738, Step: 300
2023-04-14 22:32:01 - r - INFO: - Episode: 507/2000, Reward: -72.733, Step: 253
2023-04-14 22:32:04 - r - INFO: - Episode: 508/2000, Reward: -124.510, Step: 85
2023-04-14 22:32:12 - r - INFO: - Episode: 509/2000, Reward: -69.958, Step: 253
2023-04-14 22:32:20 - r - INFO: - Episode: 510/2000, Reward: 7.528, Step: 300
2023-04-14 22:32:28 - r - INFO: - Episode: 511/2000, Reward: -18.036, Step: 300
2023-04-14 22:32:35 - r - INFO: - Episode: 512/2000, Reward: -0.229, Step: 300
2023-04-14 22:32:38 - r - INFO: - Episode: 513/2000, Reward: -128.102, Step: 125
2023-04-14 22:32:47 - r - INFO: - Episode: 514/2000, Reward: 27.667, Step: 300
2023-04-14 22:32:49 - r - INFO: - Episode: 515/2000, Reward: -117.388, Step: 85
2023-04-14 22:32:59 - r - INFO: - Episode: 516/2000, Reward: 24.092, Step: 300
2023-04-14 22:33:04 - r - INFO: - Episode: 517/2000, Reward: -101.990, Step: 190
2023-04-14 22:33:11 - r - INFO: - Episode: 518/2000, Reward: 1.162, Step: 300
2023-04-14 22:33:19 - r - INFO: - Episode: 519/2000, Reward: -13.124, Step: 300
2023-04-14 22:33:28 - r - INFO: - Episode: 520/2000, Reward: -131.202, Step: 299
2023-04-14 22:33:39 - r - INFO: - Episode: 521/2000, Reward: -83.270, Step: 197
2023-04-14 22:33:43 - r - INFO: - Episode: 522/2000, Reward: -91.839, Step: 127
2023-04-14 22:33:51 - r - INFO: - Episode: 523/2000, Reward: -6.724, Step: 300
2023-04-14 22:33:59 - r - INFO: - Episode: 524/2000, Reward: 7.276, Step: 300
2023-04-14 22:34:02 - r - INFO: - Episode: 525/2000, Reward: -99.513, Step: 132
2023-04-14 22:34:05 - r - INFO: - Episode: 526/2000, Reward: -100.401, Step: 111
2023-04-14 22:34:07 - r - INFO: - Episode: 527/2000, Reward: -103.588, Step: 69
2023-04-14 22:34:09 - r - INFO: - Episode: 528/2000, Reward: -103.973, Step: 84
2023-04-14 22:34:16 - r - INFO: - Episode: 529/2000, Reward: -80.158, Step: 213
2023-04-14 22:34:18 - r - INFO: - Episode: 530/2000, Reward: -107.177, Step: 70
2023-04-14 22:34:19 - r - INFO: - Episode: 531/2000, Reward: -107.575, Step: 46
2023-04-14 22:34:25 - r - INFO: - Episode: 532/2000, Reward: -97.890, Step: 239
2023-04-14 22:34:30 - r - INFO: - Episode: 533/2000, Reward: -81.038, Step: 177
2023-04-14 22:34:32 - r - INFO: - Episode: 534/2000, Reward: -99.902, Step: 61
2023-04-14 22:34:35 - r - INFO: - Episode: 535/2000, Reward: -93.585, Step: 127
2023-04-14 22:34:44 - r - INFO: - Episode: 536/2000, Reward: 21.766, Step: 300
2023-04-14 22:34:52 - r - INFO: - Episode: 537/2000, Reward: 30.344, Step: 300
2023-04-14 22:35:00 - r - INFO: - Episode: 538/2000, Reward: 30.996, Step: 300
2023-04-14 22:35:06 - r - INFO: - Episode: 539/2000, Reward: -85.714, Step: 222
2023-04-14 22:35:07 - r - INFO: - Episode: 540/2000, Reward: -110.874, Step: 43
2023-04-14 22:35:20 - r - INFO: - Episode: 541/2000, Reward: 39.435, Step: 300
2023-04-14 22:35:24 - r - INFO: - Episode: 542/2000, Reward: -95.660, Step: 169
2023-04-14 22:35:27 - r - INFO: - Episode: 543/2000, Reward: -108.559, Step: 99
2023-04-14 22:35:34 - r - INFO: - Episode: 544/2000, Reward: 15.237, Step: 300
2023-04-14 22:35:39 - r - INFO: - Episode: 545/2000, Reward: -107.618, Step: 194
2023-04-14 22:35:43 - r - INFO: - Episode: 546/2000, Reward: -78.937, Step: 176
2023-04-14 22:35:50 - r - INFO: - Episode: 547/2000, Reward: 36.827, Step: 300
2023-04-14 22:35:53 - r - INFO: - Episode: 548/2000, Reward: -82.974, Step: 133
2023-04-14 22:35:59 - r - INFO: - Episode: 549/2000, Reward: -89.010, Step: 232
2023-04-14 22:36:08 - r - INFO: - Episode: 550/2000, Reward: 7.724, Step: 300
2023-04-14 22:36:15 - r - INFO: - Episode: 551/2000, Reward: 8.609, Step: 300
2023-04-14 22:36:22 - r - INFO: - Episode: 552/2000, Reward: 8.295, Step: 300
2023-04-14 22:36:29 - r - INFO: - Episode: 553/2000, Reward: 31.499, Step: 300
2023-04-14 22:36:36 - r - INFO: - Episode: 554/2000, Reward: 1.121, Step: 300
2023-04-14 22:36:44 - r - INFO: - Episode: 555/2000, Reward: 33.334, Step: 300
2023-04-14 22:36:51 - r - INFO: - Episode: 556/2000, Reward: -82.817, Step: 296
2023-04-14 22:36:57 - r - INFO: - Episode: 557/2000, Reward: 29.726, Step: 300
2023-04-14 22:37:01 - r - INFO: - Episode: 558/2000, Reward: -86.928, Step: 183
2023-04-14 22:37:06 - r - INFO: - Episode: 559/2000, Reward: -64.629, Step: 221
2023-04-14 22:37:10 - r - INFO: - Episode: 560/2000, Reward: -83.511, Step: 194
2023-04-14 22:37:22 - r - INFO: - Episode: 561/2000, Reward: 19.644, Step: 300
2023-04-14 22:37:24 - r - INFO: - Episode: 562/2000, Reward: -104.485, Step: 92
2023-04-14 22:37:28 - r - INFO: - Episode: 563/2000, Reward: -108.059, Step: 177
2023-04-14 22:37:33 - r - INFO: - Episode: 564/2000, Reward: -64.374, Step: 265
2023-04-14 22:37:37 - r - INFO: - Episode: 565/2000, Reward: -84.667, Step: 174
2023-04-14 22:37:41 - r - INFO: - Episode: 566/2000, Reward: -130.736, Step: 149
2023-04-14 22:37:45 - r - INFO: - Episode: 567/2000, Reward: -90.957, Step: 161
2023-04-14 22:37:52 - r - INFO: - Episode: 568/2000, Reward: -3.764, Step: 300
2023-04-14 22:37:59 - r - INFO: - Episode: 569/2000, Reward: 16.058, Step: 300
2023-04-14 22:38:02 - r - INFO: - Episode: 570/2000, Reward: -96.846, Step: 120
2023-04-14 22:38:08 - r - INFO: - Episode: 571/2000, Reward: -81.247, Step: 250
2023-04-14 22:38:12 - r - INFO: - Episode: 572/2000, Reward: -97.397, Step: 174
2023-04-14 22:38:14 - r - INFO: - Episode: 573/2000, Reward: -124.635, Step: 110
2023-04-14 22:38:16 - r - INFO: - Episode: 574/2000, Reward: -124.741, Step: 95
2023-04-14 22:38:21 - r - INFO: - Episode: 575/2000, Reward: -114.464, Step: 167
2023-04-14 22:38:24 - r - INFO: - Episode: 576/2000, Reward: -120.341, Step: 80
2023-04-14 22:38:27 - r - INFO: - Episode: 577/2000, Reward: -120.213, Step: 96
2023-04-14 22:38:31 - r - INFO: - Episode: 578/2000, Reward: -88.383, Step: 128
2023-04-14 22:38:33 - r - INFO: - Episode: 579/2000, Reward: -83.491, Step: 123
2023-04-14 22:38:35 - r - INFO: - Episode: 580/2000, Reward: -104.120, Step: 73
2023-04-14 22:38:43 - r - INFO: - Episode: 581/2000, Reward: 12.368, Step: 300
2023-04-14 22:38:47 - r - INFO: - Episode: 582/2000, Reward: -87.133, Step: 157
2023-04-14 22:38:48 - r - INFO: - Episode: 583/2000, Reward: -101.335, Step: 70
2023-04-14 22:38:51 - r - INFO: - Episode: 584/2000, Reward: -96.509, Step: 74
2023-04-14 22:38:52 - r - INFO: - Episode: 585/2000, Reward: -98.575, Step: 68
2023-04-14 22:38:54 - r - INFO: - Episode: 586/2000, Reward: -98.553, Step: 74
2023-04-14 22:38:55 - r - INFO: - Episode: 587/2000, Reward: -97.977, Step: 64
2023-04-14 22:38:57 - r - INFO: - Episode: 588/2000, Reward: -123.441, Step: 75
2023-04-14 22:38:59 - r - INFO: - Episode: 589/2000, Reward: -100.699, Step: 62
2023-04-14 22:39:00 - r - INFO: - Episode: 590/2000, Reward: -108.131, Step: 82
2023-04-14 22:39:02 - r - INFO: - Episode: 591/2000, Reward: -96.457, Step: 74
2023-04-14 22:39:03 - r - INFO: - Episode: 592/2000, Reward: -116.816, Step: 61
2023-04-14 22:39:05 - r - INFO: - Episode: 593/2000, Reward: -112.311, Step: 87
2023-04-14 22:39:07 - r - INFO: - Episode: 594/2000, Reward: -119.607, Step: 69
2023-04-14 22:39:14 - r - INFO: - Episode: 595/2000, Reward: 3.532, Step: 300
2023-04-14 22:39:16 - r - INFO: - Episode: 596/2000, Reward: -96.115, Step: 116
2023-04-14 22:39:18 - r - INFO: - Episode: 597/2000, Reward: -114.402, Step: 85
2023-04-14 22:39:21 - r - INFO: - Episode: 598/2000, Reward: -107.910, Step: 97
2023-04-14 22:39:28 - r - INFO: - Episode: 599/2000, Reward: -8.219, Step: 300
2023-04-14 22:39:34 - r - INFO: - Episode: 600/2000, Reward: -115.683, Step: 293
2023-04-14 22:39:44 - r - INFO: - Episode: 601/2000, Reward: -19.558, Step: 300
2023-04-14 22:39:47 - r - INFO: - Episode: 602/2000, Reward: -100.150, Step: 105
2023-04-14 22:39:54 - r - INFO: - Episode: 603/2000, Reward: 33.392, Step: 300
2023-04-14 22:39:56 - r - INFO: - Episode: 604/2000, Reward: -107.879, Step: 102
2023-04-14 22:40:00 - r - INFO: - Episode: 605/2000, Reward: -133.540, Step: 174
2023-04-14 22:40:02 - r - INFO: - Episode: 606/2000, Reward: -121.886, Step: 98
2023-04-14 22:40:09 - r - INFO: - Episode: 607/2000, Reward: -99.980, Step: 293
2023-04-14 22:40:11 - r - INFO: - Episode: 608/2000, Reward: -101.122, Step: 98
2023-04-14 22:40:16 - r - INFO: - Episode: 609/2000, Reward: -125.611, Step: 209
2023-04-14 22:40:23 - r - INFO: - Episode: 610/2000, Reward: -3.215, Step: 300
2023-04-14 22:40:27 - r - INFO: - Episode: 611/2000, Reward: -113.461, Step: 178
2023-04-14 22:40:34 - r - INFO: - Episode: 612/2000, Reward: -14.623, Step: 300
2023-04-14 22:40:41 - r - INFO: - Episode: 613/2000, Reward: 17.713, Step: 300
2023-04-14 22:40:48 - r - INFO: - Episode: 614/2000, Reward: 14.531, Step: 300
2023-04-14 22:40:54 - r - INFO: - Episode: 615/2000, Reward: -100.475, Step: 259
2023-04-14 22:40:58 - r - INFO: - Episode: 616/2000, Reward: -129.272, Step: 176
2023-04-14 22:41:05 - r - INFO: - Episode: 617/2000, Reward: 4.179, Step: 300
2023-04-14 22:41:09 - r - INFO: - Episode: 618/2000, Reward: -90.178, Step: 174
2023-04-14 22:41:13 - r - INFO: - Episode: 619/2000, Reward: -87.920, Step: 148
2023-04-14 22:41:15 - r - INFO: - Episode: 620/2000, Reward: -97.940, Step: 101
2023-04-14 22:41:24 - r - INFO: - Episode: 621/2000, Reward: -141.424, Step: 173
2023-04-14 22:41:32 - r - INFO: - Episode: 622/2000, Reward: -3.468, Step: 300
2023-04-14 22:41:39 - r - INFO: - Episode: 623/2000, Reward: -95.716, Step: 136
2023-04-14 22:41:41 - r - INFO: - Episode: 624/2000, Reward: -105.132, Step: 72
2023-04-14 22:41:44 - r - INFO: - Episode: 625/2000, Reward: -91.194, Step: 118
2023-04-14 22:41:55 - r - INFO: - Episode: 626/2000, Reward: -24.811, Step: 300
2023-04-14 22:41:58 - r - INFO: - Episode: 627/2000, Reward: -91.000, Step: 106
2023-04-14 22:42:04 - r - INFO: - Episode: 628/2000, Reward: -88.905, Step: 224
2023-04-14 22:42:07 - r - INFO: - Episode: 629/2000, Reward: -110.248, Step: 128
2023-04-14 22:42:13 - r - INFO: - Episode: 630/2000, Reward: -9.651, Step: 300
2023-04-14 22:42:16 - r - INFO: - Episode: 631/2000, Reward: -100.967, Step: 118
2023-04-14 22:42:18 - r - INFO: - Episode: 632/2000, Reward: -102.751, Step: 110
2023-04-14 22:42:23 - r - INFO: - Episode: 633/2000, Reward: -102.941, Step: 167
2023-04-14 22:42:30 - r - INFO: - Episode: 634/2000, Reward: -18.258, Step: 300
2023-04-14 22:42:37 - r - INFO: - Episode: 635/2000, Reward: -14.507, Step: 300
2023-04-14 22:42:39 - r - INFO: - Episode: 636/2000, Reward: -106.032, Step: 108
2023-04-14 22:42:44 - r - INFO: - Episode: 637/2000, Reward: -74.973, Step: 206
2023-04-14 22:42:54 - r - INFO: - Episode: 638/2000, Reward: 1.251, Step: 300
2023-04-14 22:43:03 - r - INFO: - Episode: 639/2000, Reward: -12.972, Step: 300
2023-04-14 22:43:11 - r - INFO: - Episode: 640/2000, Reward: -19.759, Step: 300
2023-04-14 22:43:30 - r - INFO: - Episode: 641/2000, Reward: -27.291, Step: 300
2023-04-14 22:43:39 - r - INFO: - Episode: 642/2000, Reward: -24.548, Step: 300
2023-04-14 22:43:47 - r - INFO: - Episode: 643/2000, Reward: -27.074, Step: 300
2023-04-14 22:43:54 - r - INFO: - Episode: 644/2000, Reward: -27.967, Step: 300
2023-04-14 22:44:02 - r - INFO: - Episode: 645/2000, Reward: -12.896, Step: 300
2023-04-14 22:44:03 - r - INFO: - Episode: 646/2000, Reward: -121.157, Step: 57
2023-04-14 22:44:12 - r - INFO: - Episode: 647/2000, Reward: -18.152, Step: 300
2023-04-14 22:44:16 - r - INFO: - Episode: 648/2000, Reward: -140.197, Step: 177
2023-04-14 22:44:22 - r - INFO: - Episode: 649/2000, Reward: -139.023, Step: 249
2023-04-14 22:44:28 - r - INFO: - Episode: 650/2000, Reward: -135.843, Step: 194
2023-04-14 22:44:35 - r - INFO: - Episode: 651/2000, Reward: -41.880, Step: 300
2023-04-14 22:44:41 - r - INFO: - Episode: 652/2000, Reward: -112.651, Step: 241
2023-04-14 22:44:46 - r - INFO: - Episode: 653/2000, Reward: -134.930, Step: 196
2023-04-14 22:44:49 - r - INFO: - Episode: 654/2000, Reward: -115.894, Step: 86
2023-04-14 22:44:51 - r - INFO: - Episode: 655/2000, Reward: -110.638, Step: 70
2023-04-14 22:44:54 - r - INFO: - Episode: 656/2000, Reward: -109.468, Step: 153
2023-04-14 22:44:56 - r - INFO: - Episode: 657/2000, Reward: -107.238, Step: 88
2023-04-14 22:45:00 - r - INFO: - Episode: 658/2000, Reward: -111.913, Step: 116
2023-04-14 22:45:03 - r - INFO: - Episode: 659/2000, Reward: -108.182, Step: 69
2023-04-14 22:45:06 - r - INFO: - Episode: 660/2000, Reward: -83.345, Step: 114
2023-04-14 22:45:12 - r - INFO: - Episode: 661/2000, Reward: -112.123, Step: 85
2023-04-14 22:45:14 - r - INFO: - Episode: 662/2000, Reward: -103.055, Step: 85
2023-04-14 22:45:18 - r - INFO: - Episode: 663/2000, Reward: -92.631, Step: 159
2023-04-14 22:45:24 - r - INFO: - Episode: 664/2000, Reward: -96.356, Step: 214
2023-04-14 22:45:29 - r - INFO: - Episode: 665/2000, Reward: -107.758, Step: 143
2023-04-14 22:45:34 - r - INFO: - Episode: 666/2000, Reward: -119.437, Step: 129
2023-04-14 22:45:39 - r - INFO: - Episode: 667/2000, Reward: -101.400, Step: 185
2023-04-14 22:45:49 - r - INFO: - Episode: 668/2000, Reward: -0.478, Step: 300
2023-04-14 22:45:58 - r - INFO: - Episode: 669/2000, Reward: 1.799, Step: 300
2023-04-14 22:46:06 - r - INFO: - Episode: 670/2000, Reward: -7.655, Step: 300
2023-04-14 22:46:12 - r - INFO: - Episode: 671/2000, Reward: -99.148, Step: 219
2023-04-14 22:46:19 - r - INFO: - Episode: 672/2000, Reward: -35.466, Step: 300
2023-04-14 22:46:22 - r - INFO: - Episode: 673/2000, Reward: -118.572, Step: 89
2023-04-14 22:46:25 - r - INFO: - Episode: 674/2000, Reward: -109.019, Step: 116
2023-04-14 22:46:33 - r - INFO: - Episode: 675/2000, Reward: 20.958, Step: 300
2023-04-14 22:46:40 - r - INFO: - Episode: 676/2000, Reward: 31.429, Step: 300
2023-04-14 22:46:48 - r - INFO: - Episode: 677/2000, Reward: -66.832, Step: 279
2023-04-14 22:46:55 - r - INFO: - Episode: 678/2000, Reward: 21.515, Step: 300
2023-04-14 22:47:02 - r - INFO: - Episode: 679/2000, Reward: 15.310, Step: 300
2023-04-14 22:47:04 - r - INFO: - Episode: 680/2000, Reward: -123.405, Step: 92
2023-04-14 22:47:16 - r - INFO: - Episode: 681/2000, Reward: 0.524, Step: 300
2023-04-14 22:47:24 - r - INFO: - Episode: 682/2000, Reward: 35.969, Step: 300
2023-04-14 22:47:32 - r - INFO: - Episode: 683/2000, Reward: -9.858, Step: 300
2023-04-14 22:47:35 - r - INFO: - Episode: 684/2000, Reward: -87.654, Step: 134
2023-04-14 22:47:41 - r - INFO: - Episode: 685/2000, Reward: -72.841, Step: 237
2023-04-14 22:47:44 - r - INFO: - Episode: 686/2000, Reward: -76.318, Step: 124
2023-04-14 22:47:50 - r - INFO: - Episode: 687/2000, Reward: 21.500, Step: 300
2023-04-14 22:47:59 - r - INFO: - Episode: 688/2000, Reward: 22.707, Step: 300
2023-04-14 22:48:01 - r - INFO: - Episode: 689/2000, Reward: -109.273, Step: 108
2023-04-14 22:48:09 - r - INFO: - Episode: 690/2000, Reward: 11.130, Step: 300
2023-04-14 22:48:16 - r - INFO: - Episode: 691/2000, Reward: -11.223, Step: 300
2023-04-14 22:48:22 - r - INFO: - Episode: 692/2000, Reward: 17.899, Step: 300
2023-04-14 22:48:31 - r - INFO: - Episode: 693/2000, Reward: 2.124, Step: 300
2023-04-14 22:48:35 - r - INFO: - Episode: 694/2000, Reward: -98.751, Step: 159
2023-04-14 22:48:42 - r - INFO: - Episode: 695/2000, Reward: -9.345, Step: 300
2023-04-14 22:48:49 - r - INFO: - Episode: 696/2000, Reward: 2.439, Step: 300
2023-04-14 22:48:55 - r - INFO: - Episode: 697/2000, Reward: 3.031, Step: 300
2023-04-14 22:49:03 - r - INFO: - Episode: 698/2000, Reward: -13.047, Step: 300
2023-04-14 22:49:09 - r - INFO: - Episode: 699/2000, Reward: -18.377, Step: 300
2023-04-14 22:49:12 - r - INFO: - Episode: 700/2000, Reward: -104.498, Step: 93
2023-04-14 22:49:18 - r - INFO: - Episode: 701/2000, Reward: -107.667, Step: 86
2023-04-14 22:49:20 - r - INFO: - Episode: 702/2000, Reward: -104.048, Step: 107
2023-04-14 22:49:23 - r - INFO: - Episode: 703/2000, Reward: -101.115, Step: 147
2023-04-14 22:49:30 - r - INFO: - Episode: 704/2000, Reward: -23.682, Step: 300
2023-04-14 22:49:34 - r - INFO: - Episode: 705/2000, Reward: -124.953, Step: 163
2023-04-14 22:49:41 - r - INFO: - Episode: 706/2000, Reward: -12.355, Step: 300
2023-04-14 22:49:43 - r - INFO: - Episode: 707/2000, Reward: -113.464, Step: 112
2023-04-14 22:49:50 - r - INFO: - Episode: 708/2000, Reward: -5.759, Step: 300
2023-04-14 22:49:57 - r - INFO: - Episode: 709/2000, Reward: 8.533, Step: 300
2023-04-14 22:50:01 - r - INFO: - Episode: 710/2000, Reward: -85.131, Step: 174
2023-04-14 22:50:05 - r - INFO: - Episode: 711/2000, Reward: -89.417, Step: 169
2023-04-14 22:50:11 - r - INFO: - Episode: 712/2000, Reward: 14.458, Step: 300
2023-04-14 22:50:14 - r - INFO: - Episode: 713/2000, Reward: -122.132, Step: 123
2023-04-14 22:50:21 - r - INFO: - Episode: 714/2000, Reward: 19.988, Step: 300
2023-04-14 22:50:25 - r - INFO: - Episode: 715/2000, Reward: -80.414, Step: 184
2023-04-14 22:50:30 - r - INFO: - Episode: 716/2000, Reward: -95.670, Step: 191
2023-04-14 22:50:32 - r - INFO: - Episode: 717/2000, Reward: -91.551, Step: 96
2023-04-14 22:50:38 - r - INFO: - Episode: 718/2000, Reward: -85.730, Step: 184
2023-04-14 22:50:41 - r - INFO: - Episode: 719/2000, Reward: -113.940, Step: 85
2023-04-14 22:50:45 - r - INFO: - Episode: 720/2000, Reward: -91.913, Step: 107
2023-04-14 22:50:50 - r - INFO: - Episode: 721/2000, Reward: -97.671, Step: 110
2023-04-14 22:50:55 - r - INFO: - Episode: 722/2000, Reward: -81.294, Step: 241
2023-04-14 22:51:02 - r - INFO: - Episode: 723/2000, Reward: 32.514, Step: 300
2023-04-14 22:51:09 - r - INFO: - Episode: 724/2000, Reward: 18.011, Step: 300
2023-04-14 22:51:14 - r - INFO: - Episode: 725/2000, Reward: -75.030, Step: 214
2023-04-14 22:51:21 - r - INFO: - Episode: 726/2000, Reward: 25.294, Step: 300
2023-04-14 22:51:28 - r - INFO: - Episode: 727/2000, Reward: 18.887, Step: 300
2023-04-14 22:51:35 - r - INFO: - Episode: 728/2000, Reward: 13.518, Step: 300
2023-04-14 22:51:43 - r - INFO: - Episode: 729/2000, Reward: 13.322, Step: 300
2023-04-14 22:51:49 - r - INFO: - Episode: 730/2000, Reward: 10.878, Step: 300
2023-04-14 22:51:53 - r - INFO: - Episode: 731/2000, Reward: -113.735, Step: 173
2023-04-14 22:52:00 - r - INFO: - Episode: 732/2000, Reward: -18.569, Step: 300
2023-04-14 22:52:07 - r - INFO: - Episode: 733/2000, Reward: -31.803, Step: 300
2023-04-14 22:52:14 - r - INFO: - Episode: 734/2000, Reward: -19.255, Step: 300
2023-04-14 22:52:21 - r - INFO: - Episode: 735/2000, Reward: -26.213, Step: 300
2023-04-14 22:52:28 - r - INFO: - Episode: 736/2000, Reward: -18.068, Step: 300
2023-04-14 22:52:35 - r - INFO: - Episode: 737/2000, Reward: -8.803, Step: 300
2023-04-14 22:52:41 - r - INFO: - Episode: 738/2000, Reward: -2.386, Step: 300
2023-04-14 22:52:44 - r - INFO: - Episode: 739/2000, Reward: -112.055, Step: 116
2023-04-14 22:52:53 - r - INFO: - Episode: 740/2000, Reward: -4.976, Step: 300
2023-04-14 22:53:04 - r - INFO: - Episode: 741/2000, Reward: -106.110, Step: 280
2023-04-14 22:53:11 - r - INFO: - Episode: 742/2000, Reward: 9.559, Step: 300
2023-04-14 22:53:17 - r - INFO: - Episode: 743/2000, Reward: -2.154, Step: 300
2023-04-14 22:53:22 - r - INFO: - Episode: 744/2000, Reward: -105.158, Step: 229
2023-04-14 22:53:26 - r - INFO: - Episode: 745/2000, Reward: -93.520, Step: 150
2023-04-14 22:53:34 - r - INFO: - Episode: 746/2000, Reward: 9.796, Step: 300
2023-04-14 22:53:42 - r - INFO: - Episode: 747/2000, Reward: 20.428, Step: 300
2023-04-14 22:53:49 - r - INFO: - Episode: 748/2000, Reward: -77.742, Step: 247
2023-04-14 22:53:53 - r - INFO: - Episode: 749/2000, Reward: -79.714, Step: 162
2023-04-14 22:54:00 - r - INFO: - Episode: 750/2000, Reward: 11.843, Step: 300
2023-04-14 22:54:07 - r - INFO: - Episode: 751/2000, Reward: 17.746, Step: 300
2023-04-14 22:54:11 - r - INFO: - Episode: 752/2000, Reward: -83.242, Step: 152
2023-04-14 22:54:17 - r - INFO: - Episode: 753/2000, Reward: -68.549, Step: 234
2023-04-14 22:54:24 - r - INFO: - Episode: 754/2000, Reward: 21.695, Step: 300
2023-04-14 22:54:26 - r - INFO: - Episode: 755/2000, Reward: -107.379, Step: 77
2023-04-14 22:54:33 - r - INFO: - Episode: 756/2000, Reward: -0.439, Step: 300
2023-04-14 22:54:41 - r - INFO: - Episode: 757/2000, Reward: -15.032, Step: 300
2023-04-14 22:54:48 - r - INFO: - Episode: 758/2000, Reward: -10.704, Step: 300
2023-04-14 22:54:55 - r - INFO: - Episode: 759/2000, Reward: -6.623, Step: 300
2023-04-14 22:55:02 - r - INFO: - Episode: 760/2000, Reward: -5.784, Step: 300
2023-04-14 22:55:15 - r - INFO: - Episode: 761/2000, Reward: -95.578, Step: 298
2023-04-14 22:55:22 - r - INFO: - Episode: 762/2000, Reward: 7.207, Step: 300
2023-04-14 22:55:24 - r - INFO: - Episode: 763/2000, Reward: -104.866, Step: 77
2023-04-14 22:55:26 - r - INFO: - Episode: 764/2000, Reward: -97.809, Step: 107
2023-04-14 22:55:28 - r - INFO: - Episode: 765/2000, Reward: -98.950, Step: 67
2023-04-14 22:55:36 - r - INFO: - Episode: 766/2000, Reward: 38.510, Step: 300
2023-04-14 22:55:37 - r - INFO: - Episode: 767/2000, Reward: -108.349, Step: 63
2023-04-14 22:55:41 - r - INFO: - Episode: 768/2000, Reward: -85.671, Step: 143
2023-04-14 22:55:48 - r - INFO: - Episode: 769/2000, Reward: -9.256, Step: 300
2023-04-14 22:55:51 - r - INFO: - Episode: 770/2000, Reward: -96.755, Step: 131
2023-04-14 22:55:54 - r - INFO: - Episode: 771/2000, Reward: -77.945, Step: 143
2023-04-14 22:55:57 - r - INFO: - Episode: 772/2000, Reward: -101.966, Step: 113
2023-04-14 22:56:00 - r - INFO: - Episode: 773/2000, Reward: -104.201, Step: 141
2023-04-14 22:56:04 - r - INFO: - Episode: 774/2000, Reward: -83.863, Step: 176
2023-04-14 22:56:11 - r - INFO: - Episode: 775/2000, Reward: -23.888, Step: 300
2023-04-14 22:56:17 - r - INFO: - Episode: 776/2000, Reward: -111.473, Step: 274
2023-04-14 22:56:22 - r - INFO: - Episode: 777/2000, Reward: -108.562, Step: 220
2023-04-14 22:56:24 - r - INFO: - Episode: 778/2000, Reward: -103.102, Step: 109
2023-04-14 22:56:31 - r - INFO: - Episode: 779/2000, Reward: -20.492, Step: 300
2023-04-14 22:56:32 - r - INFO: - Episode: 780/2000, Reward: -125.577, Step: 71
2023-04-14 22:56:39 - r - INFO: - Episode: 781/2000, Reward: -120.553, Step: 76
2023-04-14 22:56:44 - r - INFO: - Episode: 782/2000, Reward: -147.412, Step: 214
2023-04-14 22:56:46 - r - INFO: - Episode: 783/2000, Reward: -117.360, Step: 81
2023-04-14 22:56:48 - r - INFO: - Episode: 784/2000, Reward: -128.931, Step: 118
2023-04-14 22:56:54 - r - INFO: - Episode: 785/2000, Reward: -88.617, Step: 250
2023-04-14 22:57:03 - r - INFO: - Episode: 786/2000, Reward: -100.007, Step: 286
2023-04-14 22:57:06 - r - INFO: - Episode: 787/2000, Reward: -94.501, Step: 102
2023-04-14 22:57:12 - r - INFO: - Episode: 788/2000, Reward: -68.989, Step: 263
2023-04-14 22:57:15 - r - INFO: - Episode: 789/2000, Reward: -129.357, Step: 153
2023-04-14 22:57:19 - r - INFO: - Episode: 790/2000, Reward: -93.380, Step: 162
2023-04-14 22:57:23 - r - INFO: - Episode: 791/2000, Reward: -92.478, Step: 183
2023-04-14 22:57:31 - r - INFO: - Episode: 792/2000, Reward: -86.031, Step: 290
2023-04-14 22:57:34 - r - INFO: - Episode: 793/2000, Reward: -98.313, Step: 127
2023-04-14 22:57:41 - r - INFO: - Episode: 794/2000, Reward: -99.514, Step: 258
2023-04-14 22:57:49 - r - INFO: - Episode: 795/2000, Reward: -32.350, Step: 300
2023-04-14 22:57:55 - r - INFO: - Episode: 796/2000, Reward: -118.482, Step: 245
2023-04-14 22:58:01 - r - INFO: - Episode: 797/2000, Reward: -111.211, Step: 229
2023-04-14 22:58:04 - r - INFO: - Episode: 798/2000, Reward: -112.294, Step: 105
2023-04-14 22:58:05 - r - INFO: - Episode: 799/2000, Reward: -124.179, Step: 45
2023-04-14 22:58:13 - r - INFO: - Episode: 800/2000, Reward: -31.865, Step: 300
2023-04-14 22:58:19 - r - INFO: - Episode: 801/2000, Reward: -109.840, Step: 79
2023-04-14 22:58:28 - r - INFO: - Episode: 802/2000, Reward: -15.290, Step: 300
2023-04-14 22:58:29 - r - INFO: - Episode: 803/2000, Reward: -114.144, Step: 48
2023-04-14 22:58:31 - r - INFO: - Episode: 804/2000, Reward: -123.328, Step: 53
2023-04-14 22:58:32 - r - INFO: - Episode: 805/2000, Reward: -114.245, Step: 42
2023-04-14 22:58:39 - r - INFO: - Episode: 806/2000, Reward: -29.994, Step: 300
2023-04-14 22:58:49 - r - INFO: - Episode: 807/2000, Reward: -14.414, Step: 300
2023-04-14 22:58:59 - r - INFO: - Episode: 808/2000, Reward: -19.690, Step: 300
2023-04-14 22:59:01 - r - INFO: - Episode: 809/2000, Reward: -121.605, Step: 53
2023-04-14 22:59:02 - r - INFO: - Episode: 810/2000, Reward: -116.045, Step: 52
2023-04-14 22:59:09 - r - INFO: - Episode: 811/2000, Reward: -20.596, Step: 300
2023-04-14 22:59:11 - r - INFO: - Episode: 812/2000, Reward: -123.491, Step: 55
2023-04-14 22:59:15 - r - INFO: - Episode: 813/2000, Reward: -118.354, Step: 172
2023-04-14 22:59:16 - r - INFO: - Episode: 814/2000, Reward: -116.801, Step: 41
2023-04-14 22:59:23 - r - INFO: - Episode: 815/2000, Reward: -22.144, Step: 300
2023-04-14 22:59:31 - r - INFO: - Episode: 816/2000, Reward: -7.144, Step: 300
2023-04-14 22:59:39 - r - INFO: - Episode: 817/2000, Reward: -11.785, Step: 300
2023-04-14 22:59:46 - r - INFO: - Episode: 818/2000, Reward: -10.094, Step: 300
2023-04-14 22:59:52 - r - INFO: - Episode: 819/2000, Reward: -94.380, Step: 268
2023-04-14 22:59:59 - r - INFO: - Episode: 820/2000, Reward: -19.939, Step: 300
2023-04-14 23:00:05 - r - INFO: - Episode: 821/2000, Reward: -116.238, Step: 152
2023-04-14 23:00:06 - r - INFO: - Episode: 822/2000, Reward: -110.370, Step: 53
2023-04-14 23:00:10 - r - INFO: - Episode: 823/2000, Reward: -87.698, Step: 168
2023-04-14 23:00:12 - r - INFO: - Episode: 824/2000, Reward: -103.481, Step: 63
2023-04-14 23:00:14 - r - INFO: - Episode: 825/2000, Reward: -102.678, Step: 81
2023-04-14 23:00:17 - r - INFO: - Episode: 826/2000, Reward: -104.059, Step: 146
2023-04-14 23:00:21 - r - INFO: - Episode: 827/2000, Reward: -86.741, Step: 151
2023-04-14 23:00:24 - r - INFO: - Episode: 828/2000, Reward: -94.374, Step: 109
2023-04-14 23:00:27 - r - INFO: - Episode: 829/2000, Reward: -82.908, Step: 137
2023-04-14 23:00:30 - r - INFO: - Episode: 830/2000, Reward: -78.090, Step: 139
2023-04-14 23:00:37 - r - INFO: - Episode: 831/2000, Reward: -87.432, Step: 205
2023-04-14 23:00:39 - r - INFO: - Episode: 832/2000, Reward: -103.993, Step: 85
2023-04-14 23:00:49 - r - INFO: - Episode: 833/2000, Reward: 25.044, Step: 300
2023-04-14 23:00:55 - r - INFO: - Episode: 834/2000, Reward: -87.360, Step: 267
2023-04-14 23:01:02 - r - INFO: - Episode: 835/2000, Reward: 32.266, Step: 300
2023-04-14 23:01:11 - r - INFO: - Episode: 836/2000, Reward: 21.561, Step: 300
2023-04-14 23:01:16 - r - INFO: - Episode: 837/2000, Reward: -75.045, Step: 138
2023-04-14 23:01:20 - r - INFO: - Episode: 838/2000, Reward: -106.789, Step: 160
2023-04-14 23:01:21 - r - INFO: - Episode: 839/2000, Reward: -113.624, Step: 50
2023-04-14 23:01:22 - r - INFO: - Episode: 840/2000, Reward: -112.705, Step: 48
2023-04-14 23:01:25 - r - INFO: - Episode: 841/2000, Reward: -120.350, Step: 71
2023-04-14 23:01:27 - r - INFO: - Episode: 842/2000, Reward: -125.245, Step: 100
2023-04-14 23:01:34 - r - INFO: - Episode: 843/2000, Reward: -80.488, Step: 290
2023-04-14 23:01:41 - r - INFO: - Episode: 844/2000, Reward: 38.437, Step: 300
2023-04-14 23:01:46 - r - INFO: - Episode: 845/2000, Reward: -75.617, Step: 192
2023-04-14 23:01:48 - r - INFO: - Episode: 846/2000, Reward: -125.194, Step: 84
2023-04-14 23:01:51 - r - INFO: - Episode: 847/2000, Reward: -96.289, Step: 147
2023-04-14 23:01:53 - r - INFO: - Episode: 848/2000, Reward: -119.931, Step: 77
2023-04-14 23:01:55 - r - INFO: - Episode: 849/2000, Reward: -118.955, Step: 71
2023-04-14 23:01:57 - r - INFO: - Episode: 850/2000, Reward: -92.421, Step: 111
2023-04-14 23:01:59 - r - INFO: - Episode: 851/2000, Reward: -114.473, Step: 75
2023-04-14 23:02:01 - r - INFO: - Episode: 852/2000, Reward: -119.281, Step: 83
2023-04-14 23:02:02 - r - INFO: - Episode: 853/2000, Reward: -116.138, Step: 67
2023-04-14 23:02:04 - r - INFO: - Episode: 854/2000, Reward: -114.424, Step: 72
2023-04-14 23:02:06 - r - INFO: - Episode: 855/2000, Reward: -115.943, Step: 63
2023-04-14 23:02:07 - r - INFO: - Episode: 856/2000, Reward: -116.635, Step: 66
2023-04-14 23:02:09 - r - INFO: - Episode: 857/2000, Reward: -120.317, Step: 78
2023-04-14 23:02:10 - r - INFO: - Episode: 858/2000, Reward: -115.245, Step: 65
2023-04-14 23:02:12 - r - INFO: - Episode: 859/2000, Reward: -115.822, Step: 60
2023-04-14 23:02:13 - r - INFO: - Episode: 860/2000, Reward: -111.030, Step: 49
2023-04-14 23:02:16 - r - INFO: - Episode: 861/2000, Reward: -114.621, Step: 59
2023-04-14 23:02:16 - r - INFO: - Episode: 862/2000, Reward: -108.063, Step: 41
2023-04-14 23:02:18 - r - INFO: - Episode: 863/2000, Reward: -122.333, Step: 84
2023-04-14 23:02:25 - r - INFO: - Episode: 864/2000, Reward: 25.381, Step: 300
2023-04-14 23:02:27 - r - INFO: - Episode: 865/2000, Reward: -117.072, Step: 90
2023-04-14 23:02:29 - r - INFO: - Episode: 866/2000, Reward: -117.133, Step: 72
2023-04-14 23:02:30 - r - INFO: - Episode: 867/2000, Reward: -114.733, Step: 60
2023-04-14 23:02:37 - r - INFO: - Episode: 868/2000, Reward: -24.689, Step: 300
2023-04-14 23:02:39 - r - INFO: - Episode: 869/2000, Reward: -125.826, Step: 87
2023-04-14 23:02:41 - r - INFO: - Episode: 870/2000, Reward: -111.365, Step: 54
2023-04-14 23:02:49 - r - INFO: - Episode: 871/2000, Reward: -22.714, Step: 300
2023-04-14 23:02:52 - r - INFO: - Episode: 872/2000, Reward: -114.423, Step: 80
2023-04-14 23:02:58 - r - INFO: - Episode: 873/2000, Reward: -122.123, Step: 221
2023-04-14 23:03:00 - r - INFO: - Episode: 874/2000, Reward: -114.110, Step: 73
2023-04-14 23:03:08 - r - INFO: - Episode: 875/2000, Reward: -22.001, Step: 300
2023-04-14 23:03:09 - r - INFO: - Episode: 876/2000, Reward: -109.293, Step: 49
2023-04-14 23:03:11 - r - INFO: - Episode: 877/2000, Reward: -114.194, Step: 71
2023-04-14 23:03:16 - r - INFO: - Episode: 878/2000, Reward: -119.527, Step: 235
2023-04-14 23:03:23 - r - INFO: - Episode: 879/2000, Reward: -16.506, Step: 300
2023-04-14 23:03:28 - r - INFO: - Episode: 880/2000, Reward: -129.152, Step: 191
2023-04-14 23:03:33 - r - INFO: - Episode: 881/2000, Reward: -123.338, Step: 147
2023-04-14 23:03:44 - r - INFO: - Episode: 882/2000, Reward: -29.342, Step: 300
2023-04-14 23:03:46 - r - INFO: - Episode: 883/2000, Reward: -125.453, Step: 96
2023-04-14 23:03:51 - r - INFO: - Episode: 884/2000, Reward: -141.932, Step: 167
2023-04-14 23:03:53 - r - INFO: - Episode: 885/2000, Reward: -103.554, Step: 91
2023-04-14 23:03:54 - r - INFO: - Episode: 886/2000, Reward: -113.680, Step: 53
2023-04-14 23:03:57 - r - INFO: - Episode: 887/2000, Reward: -127.518, Step: 116
2023-04-14 23:03:59 - r - INFO: - Episode: 888/2000, Reward: -126.488, Step: 80
2023-04-14 23:04:00 - r - INFO: - Episode: 889/2000, Reward: -118.459, Step: 52
2023-04-14 23:04:01 - r - INFO: - Episode: 890/2000, Reward: -118.289, Step: 48
2023-04-14 23:04:03 - r - INFO: - Episode: 891/2000, Reward: -130.508, Step: 90
2023-04-14 23:04:05 - r - INFO: - Episode: 892/2000, Reward: -123.968, Step: 86
2023-04-14 23:04:07 - r - INFO: - Episode: 893/2000, Reward: -120.609, Step: 83
2023-04-14 23:04:09 - r - INFO: - Episode: 894/2000, Reward: -121.235, Step: 66
2023-04-14 23:04:14 - r - INFO: - Episode: 895/2000, Reward: -130.727, Step: 153
2023-04-14 23:04:17 - r - INFO: - Episode: 896/2000, Reward: -131.004, Step: 147
2023-04-14 23:04:19 - r - INFO: - Episode: 897/2000, Reward: -124.092, Step: 68
2023-04-14 23:04:22 - r - INFO: - Episode: 898/2000, Reward: -127.586, Step: 117
2023-04-14 23:04:23 - r - INFO: - Episode: 899/2000, Reward: -118.229, Step: 73
2023-04-14 23:04:25 - r - INFO: - Episode: 900/2000, Reward: -114.351, Step: 51
2023-04-14 23:04:28 - r - INFO: - Episode: 901/2000, Reward: -122.128, Step: 94
2023-04-14 23:04:31 - r - INFO: - Episode: 902/2000, Reward: -128.521, Step: 95
2023-04-14 23:04:35 - r - INFO: - Episode: 903/2000, Reward: -140.424, Step: 188
2023-04-14 23:04:43 - r - INFO: - Episode: 904/2000, Reward: -31.118, Step: 300
2023-04-14 23:04:52 - r - INFO: - Episode: 905/2000, Reward: -29.896, Step: 300
2023-04-14 23:04:56 - r - INFO: - Episode: 906/2000, Reward: -128.014, Step: 166
2023-04-14 23:05:03 - r - INFO: - Episode: 907/2000, Reward: -26.803, Step: 300
2023-04-14 23:05:10 - r - INFO: - Episode: 908/2000, Reward: -18.593, Step: 300
2023-04-14 23:05:12 - r - INFO: - Episode: 909/2000, Reward: -106.720, Step: 84
2023-04-14 23:05:19 - r - INFO: - Episode: 910/2000, Reward: -33.963, Step: 300
2023-04-14 23:05:20 - r - INFO: - Episode: 911/2000, Reward: -108.662, Step: 61
2023-04-14 23:05:25 - r - INFO: - Episode: 912/2000, Reward: -93.990, Step: 209
2023-04-14 23:05:32 - r - INFO: - Episode: 913/2000, Reward: -24.538, Step: 300
2023-04-14 23:05:39 - r - INFO: - Episode: 914/2000, Reward: -15.354, Step: 300
2023-04-14 23:05:40 - r - INFO: - Episode: 915/2000, Reward: -110.980, Step: 51
2023-04-14 23:05:43 - r - INFO: - Episode: 916/2000, Reward: -134.207, Step: 126
2023-04-14 23:05:50 - r - INFO: - Episode: 917/2000, Reward: -23.580, Step: 300
2023-04-14 23:05:57 - r - INFO: - Episode: 918/2000, Reward: -19.745, Step: 300
2023-04-14 23:06:05 - r - INFO: - Episode: 919/2000, Reward: -21.849, Step: 300
2023-04-14 23:06:12 - r - INFO: - Episode: 920/2000, Reward: -21.701, Step: 300
2023-04-14 23:06:24 - r - INFO: - Episode: 921/2000, Reward: -24.841, Step: 300
2023-04-14 23:06:31 - r - INFO: - Episode: 922/2000, Reward: -20.734, Step: 300
2023-04-14 23:06:38 - r - INFO: - Episode: 923/2000, Reward: -14.688, Step: 300
2023-04-14 23:06:45 - r - INFO: - Episode: 924/2000, Reward: -23.787, Step: 300
2023-04-14 23:06:47 - r - INFO: - Episode: 925/2000, Reward: -117.572, Step: 73
2023-04-14 23:06:48 - r - INFO: - Episode: 926/2000, Reward: -119.216, Step: 78
2023-04-14 23:06:51 - r - INFO: - Episode: 927/2000, Reward: -129.251, Step: 105
2023-04-14 23:06:53 - r - INFO: - Episode: 928/2000, Reward: -123.160, Step: 87
2023-04-14 23:07:01 - r - INFO: - Episode: 929/2000, Reward: -24.502, Step: 300
2023-04-14 23:07:03 - r - INFO: - Episode: 930/2000, Reward: -123.163, Step: 94
2023-04-14 23:07:05 - r - INFO: - Episode: 931/2000, Reward: -123.495, Step: 71
2023-04-14 23:07:06 - r - INFO: - Episode: 932/2000, Reward: -112.632, Step: 52
2023-04-14 23:07:08 - r - INFO: - Episode: 933/2000, Reward: -124.848, Step: 75
2023-04-14 23:07:10 - r - INFO: - Episode: 934/2000, Reward: -122.094, Step: 78
2023-04-14 23:07:13 - r - INFO: - Episode: 935/2000, Reward: -142.675, Step: 119
2023-04-14 23:07:14 - r - INFO: - Episode: 936/2000, Reward: -119.940, Step: 70
2023-04-14 23:07:16 - r - INFO: - Episode: 937/2000, Reward: -120.188, Step: 89
2023-04-14 23:07:17 - r - INFO: - Episode: 938/2000, Reward: -111.917, Step: 48
2023-04-14 23:07:19 - r - INFO: - Episode: 939/2000, Reward: -118.059, Step: 67
2023-04-14 23:07:21 - r - INFO: - Episode: 940/2000, Reward: -127.742, Step: 96
2023-04-14 23:07:24 - r - INFO: - Episode: 941/2000, Reward: -120.634, Step: 79
2023-04-14 23:07:26 - r - INFO: - Episode: 942/2000, Reward: -120.067, Step: 76
2023-04-14 23:07:28 - r - INFO: - Episode: 943/2000, Reward: -118.489, Step: 67
2023-04-14 23:07:30 - r - INFO: - Episode: 944/2000, Reward: -131.052, Step: 88
2023-04-14 23:07:32 - r - INFO: - Episode: 945/2000, Reward: -126.105, Step: 89
2023-04-14 23:07:33 - r - INFO: - Episode: 946/2000, Reward: -128.112, Step: 71
2023-04-14 23:07:35 - r - INFO: - Episode: 947/2000, Reward: -121.884, Step: 77
2023-04-14 23:07:39 - r - INFO: - Episode: 948/2000, Reward: -143.213, Step: 163
2023-04-14 23:07:41 - r - INFO: - Episode: 949/2000, Reward: -121.533, Step: 64
2023-04-14 23:07:42 - r - INFO: - Episode: 950/2000, Reward: -122.558, Step: 64
2023-04-14 23:07:44 - r - INFO: - Episode: 951/2000, Reward: -124.543, Step: 70
2023-04-14 23:07:46 - r - INFO: - Episode: 952/2000, Reward: -139.658, Step: 95
2023-04-14 23:07:48 - r - INFO: - Episode: 953/2000, Reward: -124.665, Step: 78
2023-04-14 23:07:49 - r - INFO: - Episode: 954/2000, Reward: -121.017, Step: 74
2023-04-14 23:07:58 - r - INFO: - Episode: 955/2000, Reward: -17.048, Step: 300
2023-04-14 23:08:00 - r - INFO: - Episode: 956/2000, Reward: -122.533, Step: 70
2023-04-14 23:08:01 - r - INFO: - Episode: 957/2000, Reward: -106.544, Step: 59
2023-04-14 23:08:03 - r - INFO: - Episode: 958/2000, Reward: -108.349, Step: 59
2023-04-14 23:08:04 - r - INFO: - Episode: 959/2000, Reward: -123.622, Step: 60
2023-04-14 23:08:11 - r - INFO: - Episode: 960/2000, Reward: -30.974, Step: 300
2023-04-14 23:08:17 - r - INFO: - Episode: 961/2000, Reward: -110.404, Step: 70
2023-04-14 23:08:20 - r - INFO: - Episode: 962/2000, Reward: -128.460, Step: 100
2023-04-14 23:08:21 - r - INFO: - Episode: 963/2000, Reward: -117.947, Step: 71
2023-04-14 23:08:23 - r - INFO: - Episode: 964/2000, Reward: -120.271, Step: 86
2023-04-14 23:08:25 - r - INFO: - Episode: 965/2000, Reward: -128.497, Step: 86
2023-04-14 23:08:28 - r - INFO: - Episode: 966/2000, Reward: -130.830, Step: 88
2023-04-14 23:08:30 - r - INFO: - Episode: 967/2000, Reward: -120.280, Step: 81
2023-04-14 23:08:37 - r - INFO: - Episode: 968/2000, Reward: -103.548, Step: 261
2023-04-14 23:08:38 - r - INFO: - Episode: 969/2000, Reward: -114.969, Step: 69
2023-04-14 23:08:41 - r - INFO: - Episode: 970/2000, Reward: -132.032, Step: 92
2023-04-14 23:08:43 - r - INFO: - Episode: 971/2000, Reward: -121.469, Step: 76
2023-04-14 23:08:45 - r - INFO: - Episode: 972/2000, Reward: -126.400, Step: 79
2023-04-14 23:08:47 - r - INFO: - Episode: 973/2000, Reward: -127.905, Step: 87
2023-04-14 23:08:49 - r - INFO: - Episode: 974/2000, Reward: -132.928, Step: 109
2023-04-14 23:08:54 - r - INFO: - Episode: 975/2000, Reward: -111.007, Step: 206
2023-04-14 23:08:57 - r - INFO: - Episode: 976/2000, Reward: -128.938, Step: 96
2023-04-14 23:08:59 - r - INFO: - Episode: 977/2000, Reward: -129.454, Step: 107
2023-04-14 23:09:02 - r - INFO: - Episode: 978/2000, Reward: -104.660, Step: 124
2023-04-14 23:09:04 - r - INFO: - Episode: 979/2000, Reward: -118.271, Step: 71
2023-04-14 23:09:10 - r - INFO: - Episode: 980/2000, Reward: -148.851, Step: 270
2023-04-14 23:09:19 - r - INFO: - Episode: 981/2000, Reward: -96.834, Step: 189
2023-04-14 23:09:21 - r - INFO: - Episode: 982/2000, Reward: -119.483, Step: 89
2023-04-14 23:09:28 - r - INFO: - Episode: 983/2000, Reward: -2.818, Step: 300
2023-04-14 23:09:31 - r - INFO: - Episode: 984/2000, Reward: -100.582, Step: 161
2023-04-14 23:09:36 - r - INFO: - Episode: 985/2000, Reward: -96.156, Step: 208
2023-04-14 23:09:43 - r - INFO: - Episode: 986/2000, Reward: -85.931, Step: 298
2023-04-14 23:09:48 - r - INFO: - Episode: 987/2000, Reward: -95.208, Step: 224
2023-04-14 23:09:51 - r - INFO: - Episode: 988/2000, Reward: -101.291, Step: 93
2023-04-14 23:09:52 - r - INFO: - Episode: 989/2000, Reward: -103.767, Step: 61
2023-04-14 23:09:54 - r - INFO: - Episode: 990/2000, Reward: -101.811, Step: 57
2023-04-14 23:09:59 - r - INFO: - Episode: 991/2000, Reward: -95.113, Step: 199
2023-04-14 23:10:04 - r - INFO: - Episode: 992/2000, Reward: -85.808, Step: 212
2023-04-14 23:10:05 - r - INFO: - Episode: 993/2000, Reward: -108.721, Step: 38
2023-04-14 23:10:12 - r - INFO: - Episode: 994/2000, Reward: 41.557, Step: 300
2023-04-14 23:10:15 - r - INFO: - Episode: 995/2000, Reward: -86.283, Step: 143
2023-04-14 23:10:20 - r - INFO: - Episode: 996/2000, Reward: -96.202, Step: 220
2023-04-14 23:10:26 - r - INFO: - Episode: 997/2000, Reward: -139.947, Step: 281
2023-04-14 23:10:28 - r - INFO: - Episode: 998/2000, Reward: -107.014, Step: 63
2023-04-14 23:10:34 - r - INFO: - Episode: 999/2000, Reward: -79.229, Step: 247
2023-04-14 23:10:37 - r - INFO: - Episode: 1000/2000, Reward: -134.678, Step: 121
2023-04-14 23:10:40 - r - INFO: - Episode: 1001/2000, Reward: -109.934, Step: 36
2023-04-14 23:10:42 - r - INFO: - Episode: 1002/2000, Reward: -113.965, Step: 60
2023-04-14 23:10:43 - r - INFO: - Episode: 1003/2000, Reward: -109.424, Step: 69
2023-04-14 23:10:45 - r - INFO: - Episode: 1004/2000, Reward: -133.280, Step: 76
2023-04-14 23:10:49 - r - INFO: - Episode: 1005/2000, Reward: -123.751, Step: 175
2023-04-14 23:10:56 - r - INFO: - Episode: 1006/2000, Reward: -127.027, Step: 252
2023-04-14 23:11:02 - r - INFO: - Episode: 1007/2000, Reward: -123.955, Step: 252
2023-04-14 23:11:05 - r - INFO: - Episode: 1008/2000, Reward: -121.892, Step: 114
2023-04-14 23:11:08 - r - INFO: - Episode: 1009/2000, Reward: -118.969, Step: 145
2023-04-14 23:11:11 - r - INFO: - Episode: 1010/2000, Reward: -119.797, Step: 102
2023-04-14 23:11:13 - r - INFO: - Episode: 1011/2000, Reward: -121.380, Step: 98
2023-04-14 23:11:16 - r - INFO: - Episode: 1012/2000, Reward: -127.433, Step: 106
2023-04-14 23:11:20 - r - INFO: - Episode: 1013/2000, Reward: -124.296, Step: 94
2023-04-14 23:11:25 - r - INFO: - Episode: 1014/2000, Reward: -137.743, Step: 108
2023-04-14 23:11:27 - r - INFO: - Episode: 1015/2000, Reward: -126.186, Step: 86
2023-04-14 23:11:28 - r - INFO: - Episode: 1016/2000, Reward: -122.671, Step: 63
2023-04-14 23:11:31 - r - INFO: - Episode: 1017/2000, Reward: -140.276, Step: 104
2023-04-14 23:11:32 - r - INFO: - Episode: 1018/2000, Reward: -113.200, Step: 42
2023-04-14 23:11:39 - r - INFO: - Episode: 1019/2000, Reward: -149.953, Step: 279
2023-04-14 23:11:42 - r - INFO: - Episode: 1020/2000, Reward: -133.428, Step: 113
2023-04-14 23:11:44 - r - INFO: - Episode: 1021/2000, Reward: -109.011, Step: 37
2023-04-14 23:11:45 - r - INFO: - Episode: 1022/2000, Reward: -123.632, Step: 60
2023-04-14 23:11:50 - r - INFO: - Episode: 1023/2000, Reward: -123.965, Step: 180
2023-04-14 23:11:53 - r - INFO: - Episode: 1024/2000, Reward: -112.048, Step: 134
2023-04-14 23:11:54 - r - INFO: - Episode: 1025/2000, Reward: -120.322, Step: 53
2023-04-14 23:12:01 - r - INFO: - Episode: 1026/2000, Reward: -139.577, Step: 263
2023-04-14 23:12:08 - r - INFO: - Episode: 1027/2000, Reward: 1.003, Step: 300
2023-04-14 23:12:10 - r - INFO: - Episode: 1028/2000, Reward: -122.627, Step: 71
2023-04-14 23:12:13 - r - INFO: - Episode: 1029/2000, Reward: -126.732, Step: 154
2023-04-14 23:12:16 - r - INFO: - Episode: 1030/2000, Reward: -122.600, Step: 96
2023-04-14 23:12:19 - r - INFO: - Episode: 1031/2000, Reward: -99.523, Step: 138
2023-04-14 23:12:24 - r - INFO: - Episode: 1032/2000, Reward: -136.347, Step: 191
2023-04-14 23:12:29 - r - INFO: - Episode: 1033/2000, Reward: -96.404, Step: 215
2023-04-14 23:12:30 - r - INFO: - Episode: 1034/2000, Reward: -106.703, Step: 77
2023-04-14 23:12:35 - r - INFO: - Episode: 1035/2000, Reward: -140.996, Step: 220
2023-04-14 23:12:37 - r - INFO: - Episode: 1036/2000, Reward: -128.225, Step: 64
2023-04-14 23:12:39 - r - INFO: - Episode: 1037/2000, Reward: -95.370, Step: 116
2023-04-14 23:12:42 - r - INFO: - Episode: 1038/2000, Reward: -96.904, Step: 117
2023-04-14 23:12:44 - r - INFO: - Episode: 1039/2000, Reward: -105.768, Step: 73
2023-04-14 23:12:49 - r - INFO: - Episode: 1040/2000, Reward: -96.987, Step: 241
2023-04-14 23:13:00 - r - INFO: - Episode: 1041/2000, Reward: -95.867, Step: 222
2023-04-14 23:13:02 - r - INFO: - Episode: 1042/2000, Reward: -101.218, Step: 86
2023-04-14 23:13:06 - r - INFO: - Episode: 1043/2000, Reward: -99.547, Step: 150
2023-04-14 23:13:08 - r - INFO: - Episode: 1044/2000, Reward: -127.823, Step: 83
2023-04-14 23:13:13 - r - INFO: - Episode: 1045/2000, Reward: -110.475, Step: 190
2023-04-14 23:13:20 - r - INFO: - Episode: 1046/2000, Reward: -27.377, Step: 300
2023-04-14 23:13:26 - r - INFO: - Episode: 1047/2000, Reward: -119.875, Step: 299
2023-04-14 23:13:30 - r - INFO: - Episode: 1048/2000, Reward: -126.247, Step: 105
2023-04-14 23:13:34 - r - INFO: - Episode: 1049/2000, Reward: -131.617, Step: 91
2023-04-14 23:13:37 - r - INFO: - Episode: 1050/2000, Reward: -131.735, Step: 116
2023-04-14 23:13:39 - r - INFO: - Episode: 1051/2000, Reward: -108.245, Step: 108
2023-04-14 23:13:42 - r - INFO: - Episode: 1052/2000, Reward: -136.772, Step: 111
2023-04-14 23:13:50 - r - INFO: - Episode: 1053/2000, Reward: -10.996, Step: 300
2023-04-14 23:13:52 - r - INFO: - Episode: 1054/2000, Reward: -110.835, Step: 82
2023-04-14 23:13:55 - r - INFO: - Episode: 1055/2000, Reward: -125.631, Step: 93
2023-04-14 23:13:59 - r - INFO: - Episode: 1056/2000, Reward: -123.035, Step: 163
2023-04-14 23:14:02 - r - INFO: - Episode: 1057/2000, Reward: -132.722, Step: 97
2023-04-14 23:14:04 - r - INFO: - Episode: 1058/2000, Reward: -109.708, Step: 79
2023-04-14 23:14:05 - r - INFO: - Episode: 1059/2000, Reward: -115.461, Step: 77
2023-04-14 23:14:11 - r - INFO: - Episode: 1060/2000, Reward: -141.900, Step: 201
2023-04-14 23:14:21 - r - INFO: - Episode: 1061/2000, Reward: -33.908, Step: 300
2023-04-14 23:14:23 - r - INFO: - Episode: 1062/2000, Reward: -119.403, Step: 55
2023-04-14 23:14:24 - r - INFO: - Episode: 1063/2000, Reward: -114.271, Step: 69
2023-04-14 23:14:27 - r - INFO: - Episode: 1064/2000, Reward: -108.222, Step: 86
2023-04-14 23:14:30 - r - INFO: - Episode: 1065/2000, Reward: -107.141, Step: 120
2023-04-14 23:14:32 - r - INFO: - Episode: 1066/2000, Reward: -106.381, Step: 76
2023-04-14 23:14:34 - r - INFO: - Episode: 1067/2000, Reward: -105.449, Step: 73
2023-04-14 23:14:39 - r - INFO: - Episode: 1068/2000, Reward: -79.645, Step: 211
2023-04-14 23:14:41 - r - INFO: - Episode: 1069/2000, Reward: -131.168, Step: 89
2023-04-14 23:14:43 - r - INFO: - Episode: 1070/2000, Reward: -120.763, Step: 78
2023-04-14 23:14:44 - r - INFO: - Episode: 1071/2000, Reward: -111.911, Step: 71
2023-04-14 23:14:48 - r - INFO: - Episode: 1072/2000, Reward: -107.469, Step: 146
2023-04-14 23:14:50 - r - INFO: - Episode: 1073/2000, Reward: -124.821, Step: 108
2023-04-14 23:14:53 - r - INFO: - Episode: 1074/2000, Reward: -111.164, Step: 132
2023-04-14 23:14:56 - r - INFO: - Episode: 1075/2000, Reward: -111.712, Step: 131
2023-04-14 23:14:59 - r - INFO: - Episode: 1076/2000, Reward: -124.004, Step: 91
2023-04-14 23:15:06 - r - INFO: - Episode: 1077/2000, Reward: -22.455, Step: 300
2023-04-14 23:15:08 - r - INFO: - Episode: 1078/2000, Reward: -115.227, Step: 67
2023-04-14 23:15:11 - r - INFO: - Episode: 1079/2000, Reward: -98.656, Step: 120
2023-04-14 23:15:12 - r - INFO: - Episode: 1080/2000, Reward: -116.513, Step: 75
2023-04-14 23:15:15 - r - INFO: - Episode: 1081/2000, Reward: -113.865, Step: 64
2023-04-14 23:15:17 - r - INFO: - Episode: 1082/2000, Reward: -122.328, Step: 79
2023-04-14 23:15:24 - r - INFO: - Episode: 1083/2000, Reward: -16.864, Step: 300
2023-04-14 23:15:26 - r - INFO: - Episode: 1084/2000, Reward: -133.800, Step: 91
2023-04-14 23:15:28 - r - INFO: - Episode: 1085/2000, Reward: -137.750, Step: 110
2023-04-14 23:15:31 - r - INFO: - Episode: 1086/2000, Reward: -134.965, Step: 113
2023-04-14 23:15:33 - r - INFO: - Episode: 1087/2000, Reward: -123.913, Step: 67
2023-04-14 23:15:35 - r - INFO: - Episode: 1088/2000, Reward: -105.761, Step: 95
2023-04-14 23:15:42 - r - INFO: - Episode: 1089/2000, Reward: -28.101, Step: 300
2023-04-14 23:15:45 - r - INFO: - Episode: 1090/2000, Reward: -99.170, Step: 167
2023-04-14 23:15:46 - r - INFO: - Episode: 1091/2000, Reward: -110.372, Step: 44
2023-04-14 23:15:49 - r - INFO: - Episode: 1092/2000, Reward: -140.165, Step: 126
2023-04-14 23:15:56 - r - INFO: - Episode: 1093/2000, Reward: -27.469, Step: 300
2023-04-14 23:16:04 - r - INFO: - Episode: 1094/2000, Reward: -22.809, Step: 300
2023-04-14 23:16:11 - r - INFO: - Episode: 1095/2000, Reward: -29.512, Step: 300
2023-04-14 23:16:18 - r - INFO: - Episode: 1096/2000, Reward: -17.419, Step: 300
2023-04-14 23:16:25 - r - INFO: - Episode: 1097/2000, Reward: -23.032, Step: 300
2023-04-14 23:16:27 - r - INFO: - Episode: 1098/2000, Reward: -111.076, Step: 93
2023-04-14 23:16:34 - r - INFO: - Episode: 1099/2000, Reward: -27.056, Step: 300
2023-04-14 23:16:41 - r - INFO: - Episode: 1100/2000, Reward: -23.415, Step: 300
2023-04-14 23:16:52 - r - INFO: - Episode: 1101/2000, Reward: -23.411, Step: 300
2023-04-14 23:16:54 - r - INFO: - Episode: 1102/2000, Reward: -95.043, Step: 88
2023-04-14 23:17:01 - r - INFO: - Episode: 1103/2000, Reward: -29.636, Step: 300
2023-04-14 23:17:05 - r - INFO: - Episode: 1104/2000, Reward: -80.218, Step: 155
2023-04-14 23:17:13 - r - INFO: - Episode: 1105/2000, Reward: -20.491, Step: 300
2023-04-14 23:17:21 - r - INFO: - Episode: 1106/2000, Reward: -23.441, Step: 300
2023-04-14 23:17:30 - r - INFO: - Episode: 1107/2000, Reward: -16.867, Step: 300
2023-04-14 23:17:38 - r - INFO: - Episode: 1108/2000, Reward: -30.469, Step: 300
2023-04-14 23:17:46 - r - INFO: - Episode: 1109/2000, Reward: -9.263, Step: 300
2023-04-14 23:17:53 - r - INFO: - Episode: 1110/2000, Reward: -100.869, Step: 279
2023-04-14 23:17:58 - r - INFO: - Episode: 1111/2000, Reward: -104.252, Step: 177
2023-04-14 23:18:08 - r - INFO: - Episode: 1112/2000, Reward: -25.886, Step: 300
2023-04-14 23:18:13 - r - INFO: - Episode: 1113/2000, Reward: -114.779, Step: 232
2023-04-14 23:18:18 - r - INFO: - Episode: 1114/2000, Reward: -82.311, Step: 209
2023-04-14 23:18:23 - r - INFO: - Episode: 1115/2000, Reward: -78.954, Step: 221
2023-04-14 23:18:26 - r - INFO: - Episode: 1116/2000, Reward: -100.670, Step: 110
2023-04-14 23:18:32 - r - INFO: - Episode: 1117/2000, Reward: -70.599, Step: 223
2023-04-14 23:18:33 - r - INFO: - Episode: 1118/2000, Reward: -103.613, Step: 55
2023-04-14 23:18:38 - r - INFO: - Episode: 1119/2000, Reward: -100.778, Step: 148
2023-04-14 23:18:41 - r - INFO: - Episode: 1120/2000, Reward: -97.280, Step: 125
2023-04-14 23:18:49 - r - INFO: - Episode: 1121/2000, Reward: -80.809, Step: 207
2023-04-14 23:18:56 - r - INFO: - Episode: 1122/2000, Reward: -25.731, Step: 300
2023-04-14 23:19:02 - r - INFO: - Episode: 1123/2000, Reward: -96.874, Step: 193
2023-04-14 23:19:06 - r - INFO: - Episode: 1124/2000, Reward: -89.984, Step: 149
2023-04-14 23:19:08 - r - INFO: - Episode: 1125/2000, Reward: -116.171, Step: 114
2023-04-14 23:19:13 - r - INFO: - Episode: 1126/2000, Reward: -73.963, Step: 168
2023-04-14 23:19:15 - r - INFO: - Episode: 1127/2000, Reward: -112.334, Step: 114
2023-04-14 23:19:19 - r - INFO: - Episode: 1128/2000, Reward: -90.490, Step: 171
2023-04-14 23:19:24 - r - INFO: - Episode: 1129/2000, Reward: -110.219, Step: 182
2023-04-14 23:19:31 - r - INFO: - Episode: 1130/2000, Reward: 23.286, Step: 300
2023-04-14 23:19:38 - r - INFO: - Episode: 1131/2000, Reward: 9.866, Step: 300
2023-04-14 23:19:45 - r - INFO: - Episode: 1132/2000, Reward: 40.539, Step: 300
2023-04-14 23:19:53 - r - INFO: - Episode: 1133/2000, Reward: 29.305, Step: 300
2023-04-14 23:19:59 - r - INFO: - Episode: 1134/2000, Reward: 12.277, Step: 300
2023-04-14 23:20:04 - r - INFO: - Episode: 1135/2000, Reward: -93.562, Step: 188
2023-04-14 23:20:10 - r - INFO: - Episode: 1136/2000, Reward: -75.366, Step: 239
2023-04-14 23:20:13 - r - INFO: - Episode: 1137/2000, Reward: -104.148, Step: 132
2023-04-14 23:20:19 - r - INFO: - Episode: 1138/2000, Reward: 27.955, Step: 300
2023-04-14 23:20:23 - r - INFO: - Episode: 1139/2000, Reward: -94.206, Step: 167
2023-04-14 23:20:30 - r - INFO: - Episode: 1140/2000, Reward: -8.888, Step: 300
2023-04-14 23:20:36 - r - INFO: - Episode: 1141/2000, Reward: -81.982, Step: 146
2023-04-14 23:20:41 - r - INFO: - Episode: 1142/2000, Reward: -68.897, Step: 191
2023-04-14 23:20:45 - r - INFO: - Episode: 1143/2000, Reward: -67.897, Step: 182
2023-04-14 23:20:51 - r - INFO: - Episode: 1144/2000, Reward: -53.381, Step: 294
2023-04-14 23:20:59 - r - INFO: - Episode: 1145/2000, Reward: 35.384, Step: 300
2023-04-14 23:21:07 - r - INFO: - Episode: 1146/2000, Reward: -48.452, Step: 285
2023-04-14 23:21:13 - r - INFO: - Episode: 1147/2000, Reward: -70.618, Step: 212
2023-04-14 23:21:17 - r - INFO: - Episode: 1148/2000, Reward: -79.787, Step: 158
2023-04-14 23:21:21 - r - INFO: - Episode: 1149/2000, Reward: -75.091, Step: 159
2023-04-14 23:21:28 - r - INFO: - Episode: 1150/2000, Reward: -67.415, Step: 269
2023-04-14 23:21:32 - r - INFO: - Episode: 1151/2000, Reward: -75.237, Step: 152
2023-04-14 23:21:39 - r - INFO: - Episode: 1152/2000, Reward: 31.208, Step: 300
2023-04-14 23:21:47 - r - INFO: - Episode: 1153/2000, Reward: 17.079, Step: 300
2023-04-14 23:21:54 - r - INFO: - Episode: 1154/2000, Reward: 13.694, Step: 300
2023-04-14 23:21:56 - r - INFO: - Episode: 1155/2000, Reward: -92.184, Step: 87
2023-04-14 23:22:03 - r - INFO: - Episode: 1156/2000, Reward: 5.266, Step: 300
2023-04-14 23:22:11 - r - INFO: - Episode: 1157/2000, Reward: 19.428, Step: 300
2023-04-14 23:22:20 - r - INFO: - Episode: 1158/2000, Reward: 13.319, Step: 300
2023-04-14 23:22:27 - r - INFO: - Episode: 1159/2000, Reward: 20.473, Step: 300
2023-04-14 23:22:35 - r - INFO: - Episode: 1160/2000, Reward: -7.907, Step: 300
2023-04-14 23:22:51 - r - INFO: - Episode: 1161/2000, Reward: 3.270, Step: 300
2023-04-14 23:23:00 - r - INFO: - Episode: 1162/2000, Reward: 3.324, Step: 300
2023-04-14 23:23:08 - r - INFO: - Episode: 1163/2000, Reward: 7.185, Step: 300
2023-04-14 23:23:15 - r - INFO: - Episode: 1164/2000, Reward: 6.277, Step: 300
2023-04-14 23:23:22 - r - INFO: - Episode: 1165/2000, Reward: 1.122, Step: 300
2023-04-14 23:23:28 - r - INFO: - Episode: 1166/2000, Reward: -95.477, Step: 250
2023-04-14 23:23:31 - r - INFO: - Episode: 1167/2000, Reward: -87.831, Step: 121
2023-04-14 23:23:40 - r - INFO: - Episode: 1168/2000, Reward: 25.185, Step: 300
2023-04-14 23:23:47 - r - INFO: - Episode: 1169/2000, Reward: -77.789, Step: 221
2023-04-14 23:23:50 - r - INFO: - Episode: 1170/2000, Reward: -92.155, Step: 160
2023-04-14 23:23:58 - r - INFO: - Episode: 1171/2000, Reward: -66.537, Step: 295
2023-04-14 23:24:06 - r - INFO: - Episode: 1172/2000, Reward: -62.810, Step: 273
2023-04-14 23:24:10 - r - INFO: - Episode: 1173/2000, Reward: -106.821, Step: 152
2023-04-14 23:24:14 - r - INFO: - Episode: 1174/2000, Reward: -85.504, Step: 169
2023-04-14 23:24:18 - r - INFO: - Episode: 1175/2000, Reward: -91.321, Step: 147
2023-04-14 23:24:21 - r - INFO: - Episode: 1176/2000, Reward: -103.038, Step: 110
2023-04-14 23:24:24 - r - INFO: - Episode: 1177/2000, Reward: -96.160, Step: 112
2023-04-14 23:24:28 - r - INFO: - Episode: 1178/2000, Reward: -99.421, Step: 125
2023-04-14 23:24:32 - r - INFO: - Episode: 1179/2000, Reward: -95.756, Step: 176
2023-04-14 23:24:36 - r - INFO: - Episode: 1180/2000, Reward: -87.080, Step: 134
2023-04-14 23:24:48 - r - INFO: - Episode: 1181/2000, Reward: -140.673, Step: 190
2023-04-14 23:24:57 - r - INFO: - Episode: 1182/2000, Reward: -82.484, Step: 297
2023-04-14 23:25:05 - r - INFO: - Episode: 1183/2000, Reward: -16.981, Step: 300
2023-04-14 23:25:13 - r - INFO: - Episode: 1184/2000, Reward: -2.079, Step: 300
2023-04-14 23:25:20 - r - INFO: - Episode: 1185/2000, Reward: -34.987, Step: 300
2023-04-14 23:25:28 - r - INFO: - Episode: 1186/2000, Reward: -18.021, Step: 300
2023-04-14 23:25:35 - r - INFO: - Episode: 1187/2000, Reward: -27.799, Step: 300
2023-04-14 23:25:43 - r - INFO: - Episode: 1188/2000, Reward: 34.974, Step: 300
2023-04-14 23:25:48 - r - INFO: - Episode: 1189/2000, Reward: -139.666, Step: 232
2023-04-14 23:25:55 - r - INFO: - Episode: 1190/2000, Reward: -0.713, Step: 300
2023-04-14 23:26:03 - r - INFO: - Episode: 1191/2000, Reward: -12.751, Step: 300
2023-04-14 23:26:05 - r - INFO: - Episode: 1192/2000, Reward: -103.613, Step: 78
2023-04-14 23:26:08 - r - INFO: - Episode: 1193/2000, Reward: -101.301, Step: 103
2023-04-14 23:26:16 - r - INFO: - Episode: 1194/2000, Reward: -0.840, Step: 300
2023-04-14 23:26:23 - r - INFO: - Episode: 1195/2000, Reward: -49.758, Step: 298
2023-04-14 23:26:26 - r - INFO: - Episode: 1196/2000, Reward: -102.925, Step: 125
2023-04-14 23:26:29 - r - INFO: - Episode: 1197/2000, Reward: -108.321, Step: 114
2023-04-14 23:26:34 - r - INFO: - Episode: 1198/2000, Reward: -99.596, Step: 173
2023-04-14 23:26:36 - r - INFO: - Episode: 1199/2000, Reward: -96.534, Step: 116
2023-04-14 23:26:40 - r - INFO: - Episode: 1200/2000, Reward: -100.006, Step: 144
2023-04-14 23:26:47 - r - INFO: - Episode: 1201/2000, Reward: -94.046, Step: 177
2023-04-14 23:26:54 - r - INFO: - Episode: 1202/2000, Reward: 39.233, Step: 300
2023-04-14 23:26:55 - r - INFO: - Episode: 1203/2000, Reward: -112.379, Step: 55
2023-04-14 23:26:58 - r - INFO: - Episode: 1204/2000, Reward: -99.375, Step: 127
2023-04-14 23:27:01 - r - INFO: - Episode: 1205/2000, Reward: -110.924, Step: 110
2023-04-14 23:27:03 - r - INFO: - Episode: 1206/2000, Reward: -112.982, Step: 66
2023-04-14 23:27:05 - r - INFO: - Episode: 1207/2000, Reward: -97.337, Step: 123
2023-04-14 23:27:07 - r - INFO: - Episode: 1208/2000, Reward: -127.499, Step: 72
2023-04-14 23:27:09 - r - INFO: - Episode: 1209/2000, Reward: -104.303, Step: 80
2023-04-14 23:27:12 - r - INFO: - Episode: 1210/2000, Reward: -99.124, Step: 105
2023-04-14 23:27:15 - r - INFO: - Episode: 1211/2000, Reward: -97.943, Step: 107
2023-04-14 23:27:20 - r - INFO: - Episode: 1212/2000, Reward: -79.893, Step: 209
2023-04-14 23:27:27 - r - INFO: - Episode: 1213/2000, Reward: 26.092, Step: 300
2023-04-14 23:27:31 - r - INFO: - Episode: 1214/2000, Reward: -100.473, Step: 152
2023-04-14 23:27:33 - r - INFO: - Episode: 1215/2000, Reward: -111.607, Step: 114
2023-04-14 23:27:35 - r - INFO: - Episode: 1216/2000, Reward: -121.697, Step: 62
2023-04-14 23:27:36 - r - INFO: - Episode: 1217/2000, Reward: -123.836, Step: 64
2023-04-14 23:27:39 - r - INFO: - Episode: 1218/2000, Reward: -113.891, Step: 118
2023-04-14 23:27:45 - r - INFO: - Episode: 1219/2000, Reward: 4.738, Step: 300
2023-04-14 23:27:47 - r - INFO: - Episode: 1220/2000, Reward: -116.863, Step: 48
2023-04-14 23:27:57 - r - INFO: - Episode: 1221/2000, Reward: 22.106, Step: 300
2023-04-14 23:27:58 - r - INFO: - Episode: 1222/2000, Reward: -116.664, Step: 47
2023-04-14 23:28:00 - r - INFO: - Episode: 1223/2000, Reward: -124.949, Step: 69
2023-04-14 23:28:02 - r - INFO: - Episode: 1224/2000, Reward: -117.799, Step: 53
2023-04-14 23:28:04 - r - INFO: - Episode: 1225/2000, Reward: -138.147, Step: 98
2023-04-14 23:28:06 - r - INFO: - Episode: 1226/2000, Reward: -130.019, Step: 73
2023-04-14 23:28:08 - r - INFO: - Episode: 1227/2000, Reward: -133.804, Step: 85
2023-04-14 23:28:10 - r - INFO: - Episode: 1228/2000, Reward: -133.384, Step: 77
2023-04-14 23:28:14 - r - INFO: - Episode: 1229/2000, Reward: -102.023, Step: 177
2023-04-14 23:28:17 - r - INFO: - Episode: 1230/2000, Reward: -133.552, Step: 113
2023-04-14 23:28:23 - r - INFO: - Episode: 1231/2000, Reward: 24.599, Step: 300
2023-04-14 23:28:24 - r - INFO: - Episode: 1232/2000, Reward: -114.121, Step: 43
2023-04-14 23:28:26 - r - INFO: - Episode: 1233/2000, Reward: -120.434, Step: 68
2023-04-14 23:28:28 - r - INFO: - Episode: 1234/2000, Reward: -132.424, Step: 96
2023-04-14 23:28:29 - r - INFO: - Episode: 1235/2000, Reward: -124.290, Step: 68
2023-04-14 23:28:31 - r - INFO: - Episode: 1236/2000, Reward: -120.895, Step: 74
2023-04-14 23:28:33 - r - INFO: - Episode: 1237/2000, Reward: -121.481, Step: 58
2023-04-14 23:28:35 - r - INFO: - Episode: 1238/2000, Reward: -126.100, Step: 77
2023-04-14 23:28:37 - r - INFO: - Episode: 1239/2000, Reward: -134.183, Step: 88
2023-04-14 23:28:39 - r - INFO: - Episode: 1240/2000, Reward: -125.324, Step: 79
2023-04-14 23:28:42 - r - INFO: - Episode: 1241/2000, Reward: -129.809, Step: 90
2023-04-14 23:28:44 - r - INFO: - Episode: 1242/2000, Reward: -125.807, Step: 65
2023-04-14 23:28:47 - r - INFO: - Episode: 1243/2000, Reward: -141.158, Step: 123
2023-04-14 23:28:48 - r - INFO: - Episode: 1244/2000, Reward: -116.503, Step: 50
2023-04-14 23:28:51 - r - INFO: - Episode: 1245/2000, Reward: -137.312, Step: 123
2023-04-14 23:28:53 - r - INFO: - Episode: 1246/2000, Reward: -130.109, Step: 75
2023-04-14 23:28:54 - r - INFO: - Episode: 1247/2000, Reward: -122.455, Step: 71
2023-04-14 23:28:55 - r - INFO: - Episode: 1248/2000, Reward: -105.179, Step: 58
2023-04-14 23:28:57 - r - INFO: - Episode: 1249/2000, Reward: -128.076, Step: 71
2023-04-14 23:29:01 - r - INFO: - Episode: 1250/2000, Reward: -136.421, Step: 170
2023-04-14 23:29:04 - r - INFO: - Episode: 1251/2000, Reward: -137.003, Step: 151
2023-04-14 23:29:06 - r - INFO: - Episode: 1252/2000, Reward: -111.689, Step: 77
2023-04-14 23:29:09 - r - INFO: - Episode: 1253/2000, Reward: -97.895, Step: 146
2023-04-14 23:29:11 - r - INFO: - Episode: 1254/2000, Reward: -129.071, Step: 107
2023-04-14 23:29:16 - r - INFO: - Episode: 1255/2000, Reward: -130.459, Step: 174
2023-04-14 23:29:18 - r - INFO: - Episode: 1256/2000, Reward: -111.020, Step: 90
2023-04-14 23:29:21 - r - INFO: - Episode: 1257/2000, Reward: -125.185, Step: 120
2023-04-14 23:29:23 - r - INFO: - Episode: 1258/2000, Reward: -118.608, Step: 75
2023-04-14 23:29:25 - r - INFO: - Episode: 1259/2000, Reward: -123.879, Step: 97
2023-04-14 23:29:27 - r - INFO: - Episode: 1260/2000, Reward: -135.509, Step: 94
2023-04-14 23:29:31 - r - INFO: - Episode: 1261/2000, Reward: -126.490, Step: 113
2023-04-14 23:29:33 - r - INFO: - Episode: 1262/2000, Reward: -128.191, Step: 68
2023-04-14 23:29:40 - r - INFO: - Episode: 1263/2000, Reward: -19.499, Step: 300
2023-04-14 23:29:46 - r - INFO: - Episode: 1264/2000, Reward: -18.977, Step: 300
2023-04-14 23:29:54 - r - INFO: - Episode: 1265/2000, Reward: -22.799, Step: 300
2023-04-14 23:30:01 - r - INFO: - Episode: 1266/2000, Reward: -24.661, Step: 300
2023-04-14 23:30:09 - r - INFO: - Episode: 1267/2000, Reward: -25.001, Step: 300
2023-04-14 23:30:17 - r - INFO: - Episode: 1268/2000, Reward: -23.811, Step: 300
2023-04-14 23:30:24 - r - INFO: - Episode: 1269/2000, Reward: -13.859, Step: 300
2023-04-14 23:30:30 - r - INFO: - Episode: 1270/2000, Reward: -129.014, Step: 249
2023-04-14 23:30:32 - r - INFO: - Episode: 1271/2000, Reward: -107.268, Step: 63
2023-04-14 23:30:36 - r - INFO: - Episode: 1272/2000, Reward: -105.071, Step: 158
2023-04-14 23:30:38 - r - INFO: - Episode: 1273/2000, Reward: -125.899, Step: 84
2023-04-14 23:30:42 - r - INFO: - Episode: 1274/2000, Reward: -115.864, Step: 171
2023-04-14 23:30:45 - r - INFO: - Episode: 1275/2000, Reward: -97.976, Step: 124
2023-04-14 23:30:48 - r - INFO: - Episode: 1276/2000, Reward: -98.976, Step: 137
2023-04-14 23:30:51 - r - INFO: - Episode: 1277/2000, Reward: -99.077, Step: 97
2023-04-14 23:30:53 - r - INFO: - Episode: 1278/2000, Reward: -131.328, Step: 88
2023-04-14 23:30:55 - r - INFO: - Episode: 1279/2000, Reward: -124.756, Step: 91
2023-04-14 23:30:58 - r - INFO: - Episode: 1280/2000, Reward: -139.748, Step: 145
2023-04-14 23:31:06 - r - INFO: - Episode: 1281/2000, Reward: -115.585, Step: 160
2023-04-14 23:31:15 - r - INFO: - Episode: 1282/2000, Reward: 58.381, Step: 300
2023-04-14 23:31:23 - r - INFO: - Episode: 1283/2000, Reward: 60.660, Step: 300
2023-04-14 23:31:28 - r - INFO: - Episode: 1284/2000, Reward: -86.092, Step: 204
2023-04-14 23:31:33 - r - INFO: - Episode: 1285/2000, Reward: -115.583, Step: 199
2023-04-14 23:31:40 - r - INFO: - Episode: 1286/2000, Reward: -27.411, Step: 300
2023-04-14 23:31:47 - r - INFO: - Episode: 1287/2000, Reward: -33.875, Step: 300
2023-04-14 23:31:54 - r - INFO: - Episode: 1288/2000, Reward: -32.934, Step: 300
2023-04-14 23:32:01 - r - INFO: - Episode: 1289/2000, Reward: -37.839, Step: 300
2023-04-14 23:32:09 - r - INFO: - Episode: 1290/2000, Reward: -32.036, Step: 300
2023-04-14 23:32:16 - r - INFO: - Episode: 1291/2000, Reward: -27.863, Step: 300
2023-04-14 23:32:19 - r - INFO: - Episode: 1292/2000, Reward: -113.433, Step: 78
2023-04-14 23:32:22 - r - INFO: - Episode: 1293/2000, Reward: -134.461, Step: 129
2023-04-14 23:32:24 - r - INFO: - Episode: 1294/2000, Reward: -86.639, Step: 121
2023-04-14 23:32:27 - r - INFO: - Episode: 1295/2000, Reward: -100.422, Step: 116
2023-04-14 23:32:34 - r - INFO: - Episode: 1296/2000, Reward: -18.552, Step: 300
2023-04-14 23:32:41 - r - INFO: - Episode: 1297/2000, Reward: -23.260, Step: 300
2023-04-14 23:32:48 - r - INFO: - Episode: 1298/2000, Reward: -19.504, Step: 300
2023-04-14 23:32:51 - r - INFO: - Episode: 1299/2000, Reward: -126.011, Step: 150
2023-04-14 23:32:58 - r - INFO: - Episode: 1300/2000, Reward: -25.081, Step: 300
2023-04-14 23:33:11 - r - INFO: - Episode: 1301/2000, Reward: -10.573, Step: 300
2023-04-14 23:33:13 - r - INFO: - Episode: 1302/2000, Reward: -99.195, Step: 89
2023-04-14 23:33:15 - r - INFO: - Episode: 1303/2000, Reward: -99.651, Step: 111
2023-04-14 23:33:23 - r - INFO: - Episode: 1304/2000, Reward: -22.245, Step: 300
2023-04-14 23:33:27 - r - INFO: - Episode: 1305/2000, Reward: -96.381, Step: 191
2023-04-14 23:33:30 - r - INFO: - Episode: 1306/2000, Reward: -101.638, Step: 109
2023-04-14 23:33:31 - r - INFO: - Episode: 1307/2000, Reward: -101.102, Step: 59
2023-04-14 23:33:39 - r - INFO: - Episode: 1308/2000, Reward: -137.498, Step: 255
2023-04-14 23:33:45 - r - INFO: - Episode: 1309/2000, Reward: -14.349, Step: 300
2023-04-14 23:33:53 - r - INFO: - Episode: 1310/2000, Reward: -8.653, Step: 300
2023-04-14 23:33:59 - r - INFO: - Episode: 1311/2000, Reward: -21.739, Step: 300
2023-04-14 23:34:04 - r - INFO: - Episode: 1312/2000, Reward: -99.929, Step: 180
2023-04-14 23:34:05 - r - INFO: - Episode: 1313/2000, Reward: -106.698, Step: 48
2023-04-14 23:34:06 - r - INFO: - Episode: 1314/2000, Reward: -104.556, Step: 44
2023-04-14 23:34:08 - r - INFO: - Episode: 1315/2000, Reward: -100.291, Step: 79
2023-04-14 23:34:10 - r - INFO: - Episode: 1316/2000, Reward: -103.948, Step: 74
2023-04-14 23:34:11 - r - INFO: - Episode: 1317/2000, Reward: -99.910, Step: 73
2023-04-14 23:34:22 - r - INFO: - Episode: 1318/2000, Reward: -0.222, Step: 300
2023-04-14 23:34:26 - r - INFO: - Episode: 1319/2000, Reward: -86.630, Step: 100
2023-04-14 23:34:32 - r - INFO: - Episode: 1320/2000, Reward: -70.101, Step: 208
2023-04-14 23:34:42 - r - INFO: - Episode: 1321/2000, Reward: -74.397, Step: 212
2023-04-14 23:34:45 - r - INFO: - Episode: 1322/2000, Reward: -115.434, Step: 133
2023-04-14 23:34:52 - r - INFO: - Episode: 1323/2000, Reward: 18.171, Step: 300
2023-04-14 23:35:00 - r - INFO: - Episode: 1324/2000, Reward: -0.234, Step: 300
2023-04-14 23:35:06 - r - INFO: - Episode: 1325/2000, Reward: -110.254, Step: 221
2023-04-14 23:35:13 - r - INFO: - Episode: 1326/2000, Reward: -115.264, Step: 168
2023-04-14 23:35:21 - r - INFO: - Episode: 1327/2000, Reward: -4.720, Step: 300
2023-04-14 23:35:25 - r - INFO: - Episode: 1328/2000, Reward: -133.552, Step: 132
2023-04-14 23:35:27 - r - INFO: - Episode: 1329/2000, Reward: -114.229, Step: 77
2023-04-14 23:35:29 - r - INFO: - Episode: 1330/2000, Reward: -131.157, Step: 103
2023-04-14 23:35:31 - r - INFO: - Episode: 1331/2000, Reward: -129.529, Step: 78
2023-04-14 23:35:36 - r - INFO: - Episode: 1332/2000, Reward: -96.241, Step: 178
2023-04-14 23:35:38 - r - INFO: - Episode: 1333/2000, Reward: -117.346, Step: 65
2023-04-14 23:35:43 - r - INFO: - Episode: 1334/2000, Reward: -87.999, Step: 194
2023-04-14 23:35:44 - r - INFO: - Episode: 1335/2000, Reward: -117.072, Step: 64
2023-04-14 23:35:46 - r - INFO: - Episode: 1336/2000, Reward: -116.638, Step: 67
2023-04-14 23:35:48 - r - INFO: - Episode: 1337/2000, Reward: -113.873, Step: 65
2023-04-14 23:35:50 - r - INFO: - Episode: 1338/2000, Reward: -113.145, Step: 55
2023-04-14 23:35:52 - r - INFO: - Episode: 1339/2000, Reward: -115.767, Step: 64
2023-04-14 23:35:53 - r - INFO: - Episode: 1340/2000, Reward: -113.802, Step: 53
2023-04-14 23:35:56 - r - INFO: - Episode: 1341/2000, Reward: -111.741, Step: 60
2023-04-14 23:35:58 - r - INFO: - Episode: 1342/2000, Reward: -121.628, Step: 87
2023-04-14 23:35:59 - r - INFO: - Episode: 1343/2000, Reward: -114.328, Step: 54
2023-04-14 23:36:01 - r - INFO: - Episode: 1344/2000, Reward: -113.223, Step: 56
2023-04-14 23:36:02 - r - INFO: - Episode: 1345/2000, Reward: -116.138, Step: 57
2023-04-14 23:36:05 - r - INFO: - Episode: 1346/2000, Reward: -125.385, Step: 92
2023-04-14 23:36:06 - r - INFO: - Episode: 1347/2000, Reward: -115.124, Step: 57
2023-04-14 23:36:07 - r - INFO: - Episode: 1348/2000, Reward: -116.059, Step: 54
2023-04-14 23:36:09 - r - INFO: - Episode: 1349/2000, Reward: -116.591, Step: 64
2023-04-14 23:36:11 - r - INFO: - Episode: 1350/2000, Reward: -121.798, Step: 77
2023-04-14 23:36:14 - r - INFO: - Episode: 1351/2000, Reward: -122.187, Step: 100
2023-04-14 23:36:16 - r - INFO: - Episode: 1352/2000, Reward: -122.295, Step: 67
2023-04-14 23:36:19 - r - INFO: - Episode: 1353/2000, Reward: -123.317, Step: 84
2023-04-14 23:36:22 - r - INFO: - Episode: 1354/2000, Reward: -127.417, Step: 90
2023-04-14 23:36:26 - r - INFO: - Episode: 1355/2000, Reward: -132.939, Step: 110
2023-04-14 23:36:30 - r - INFO: - Episode: 1356/2000, Reward: -136.415, Step: 174
2023-04-14 23:36:35 - r - INFO: - Episode: 1357/2000, Reward: -140.753, Step: 164
2023-04-14 23:36:43 - r - INFO: - Episode: 1358/2000, Reward: 19.578, Step: 300
2023-04-14 23:36:48 - r - INFO: - Episode: 1359/2000, Reward: -86.615, Step: 211
2023-04-14 23:36:56 - r - INFO: - Episode: 1360/2000, Reward: -11.702, Step: 300
2023-04-14 23:37:01 - r - INFO: - Episode: 1361/2000, Reward: -135.531, Step: 151
2023-04-14 23:37:04 - r - INFO: - Episode: 1362/2000, Reward: -104.160, Step: 94
2023-04-14 23:37:12 - r - INFO: - Episode: 1363/2000, Reward: -23.578, Step: 300
2023-04-14 23:37:16 - r - INFO: - Episode: 1364/2000, Reward: -104.381, Step: 166
2023-04-14 23:37:22 - r - INFO: - Episode: 1365/2000, Reward: -87.264, Step: 237
2023-04-14 23:37:26 - r - INFO: - Episode: 1366/2000, Reward: -93.256, Step: 145
2023-04-14 23:37:29 - r - INFO: - Episode: 1367/2000, Reward: -103.935, Step: 90
2023-04-14 23:37:33 - r - INFO: - Episode: 1368/2000, Reward: -126.192, Step: 170
2023-04-14 23:37:43 - r - INFO: - Episode: 1369/2000, Reward: 35.276, Step: 300
2023-04-14 23:37:56 - r - INFO: - Episode: 1370/2000, Reward: -0.889, Step: 300
2023-04-14 23:38:07 - r - INFO: - Episode: 1371/2000, Reward: -104.684, Step: 101
2023-04-14 23:38:19 - r - INFO: - Episode: 1372/2000, Reward: -112.018, Step: 194
2023-04-14 23:38:24 - r - INFO: - Episode: 1373/2000, Reward: -69.723, Step: 213
2023-04-14 23:38:29 - r - INFO: - Episode: 1374/2000, Reward: -108.704, Step: 186
2023-04-14 23:38:34 - r - INFO: - Episode: 1375/2000, Reward: -91.788, Step: 141
2023-04-14 23:38:39 - r - INFO: - Episode: 1376/2000, Reward: -121.087, Step: 161
2023-04-14 23:38:45 - r - INFO: - Episode: 1377/2000, Reward: -91.231, Step: 234
2023-04-14 23:38:50 - r - INFO: - Episode: 1378/2000, Reward: -79.006, Step: 185
2023-04-14 23:38:53 - r - INFO: - Episode: 1379/2000, Reward: -141.827, Step: 122
2023-04-14 23:38:56 - r - INFO: - Episode: 1380/2000, Reward: -110.454, Step: 114
2023-04-14 23:39:04 - r - INFO: - Episode: 1381/2000, Reward: -139.588, Step: 194
2023-04-14 23:39:07 - r - INFO: - Episode: 1382/2000, Reward: -109.302, Step: 148
2023-04-14 23:39:10 - r - INFO: - Episode: 1383/2000, Reward: -124.375, Step: 107
2023-04-14 23:39:12 - r - INFO: - Episode: 1384/2000, Reward: -119.234, Step: 64
2023-04-14 23:39:17 - r - INFO: - Episode: 1385/2000, Reward: -127.216, Step: 227
2023-04-14 23:39:19 - r - INFO: - Episode: 1386/2000, Reward: -116.982, Step: 70
2023-04-14 23:39:21 - r - INFO: - Episode: 1387/2000, Reward: -94.051, Step: 91
2023-04-14 23:39:24 - r - INFO: - Episode: 1388/2000, Reward: -91.076, Step: 133
2023-04-14 23:39:28 - r - INFO: - Episode: 1389/2000, Reward: -94.101, Step: 96
2023-04-14 23:39:34 - r - INFO: - Episode: 1390/2000, Reward: -105.008, Step: 279
2023-04-14 23:39:40 - r - INFO: - Episode: 1391/2000, Reward: -85.668, Step: 242
2023-04-14 23:39:43 - r - INFO: - Episode: 1392/2000, Reward: -87.797, Step: 134
2023-04-14 23:39:50 - r - INFO: - Episode: 1393/2000, Reward: 24.796, Step: 300
2023-04-14 23:39:57 - r - INFO: - Episode: 1394/2000, Reward: 5.943, Step: 300
2023-04-14 23:40:05 - r - INFO: - Episode: 1395/2000, Reward: -5.758, Step: 300
2023-04-14 23:40:08 - r - INFO: - Episode: 1396/2000, Reward: -108.725, Step: 92
2023-04-14 23:40:10 - r - INFO: - Episode: 1397/2000, Reward: -120.491, Step: 73
2023-04-14 23:40:16 - r - INFO: - Episode: 1398/2000, Reward: -131.839, Step: 227
2023-04-14 23:40:20 - r - INFO: - Episode: 1399/2000, Reward: -117.692, Step: 165
2023-04-14 23:40:27 - r - INFO: - Episode: 1400/2000, Reward: -123.747, Step: 259
2023-04-14 23:40:37 - r - INFO: - Episode: 1401/2000, Reward: -110.153, Step: 131
2023-04-14 23:40:49 - r - INFO: - Episode: 1402/2000, Reward: 8.364, Step: 300
2023-04-14 23:40:52 - r - INFO: - Episode: 1403/2000, Reward: -92.425, Step: 128
2023-04-14 23:40:54 - r - INFO: - Episode: 1404/2000, Reward: -120.444, Step: 81
2023-04-14 23:41:04 - r - INFO: - Episode: 1405/2000, Reward: 21.941, Step: 300
2023-04-14 23:41:12 - r - INFO: - Episode: 1406/2000, Reward: -8.672, Step: 300
2023-04-14 23:41:16 - r - INFO: - Episode: 1407/2000, Reward: -130.186, Step: 129
2023-04-14 23:41:23 - r - INFO: - Episode: 1408/2000, Reward: -75.557, Step: 260
2023-04-14 23:41:32 - r - INFO: - Episode: 1409/2000, Reward: 11.967, Step: 300
2023-04-14 23:41:38 - r - INFO: - Episode: 1410/2000, Reward: -99.667, Step: 254
2023-04-14 23:41:42 - r - INFO: - Episode: 1411/2000, Reward: -100.144, Step: 150
2023-04-14 23:41:48 - r - INFO: - Episode: 1412/2000, Reward: -94.119, Step: 251
2023-04-14 23:41:53 - r - INFO: - Episode: 1413/2000, Reward: -114.746, Step: 229
2023-04-14 23:41:57 - r - INFO: - Episode: 1414/2000, Reward: -101.113, Step: 169
2023-04-14 23:42:00 - r - INFO: - Episode: 1415/2000, Reward: -102.843, Step: 123
2023-04-14 23:42:04 - r - INFO: - Episode: 1416/2000, Reward: -109.107, Step: 175
2023-04-14 23:42:11 - r - INFO: - Episode: 1417/2000, Reward: -102.857, Step: 279
2023-04-14 23:42:17 - r - INFO: - Episode: 1418/2000, Reward: -68.144, Step: 228
2023-04-14 23:42:23 - r - INFO: - Episode: 1419/2000, Reward: -79.536, Step: 250
2023-04-14 23:42:31 - r - INFO: - Episode: 1420/2000, Reward: 28.307, Step: 300
2023-04-14 23:42:41 - r - INFO: - Episode: 1421/2000, Reward: -101.723, Step: 249
2023-04-14 23:42:48 - r - INFO: - Episode: 1422/2000, Reward: -81.656, Step: 265
2023-04-14 23:42:52 - r - INFO: - Episode: 1423/2000, Reward: -121.929, Step: 200
2023-04-14 23:42:57 - r - INFO: - Episode: 1424/2000, Reward: -99.803, Step: 185
2023-04-14 23:42:59 - r - INFO: - Episode: 1425/2000, Reward: -113.119, Step: 71
2023-04-14 23:43:02 - r - INFO: - Episode: 1426/2000, Reward: -106.726, Step: 119
2023-04-14 23:43:07 - r - INFO: - Episode: 1427/2000, Reward: -69.820, Step: 167
2023-04-14 23:43:11 - r - INFO: - Episode: 1428/2000, Reward: -93.626, Step: 152
2023-04-14 23:43:14 - r - INFO: - Episode: 1429/2000, Reward: -100.359, Step: 110
2023-04-14 23:43:22 - r - INFO: - Episode: 1430/2000, Reward: 36.459, Step: 300
2023-04-14 23:43:30 - r - INFO: - Episode: 1431/2000, Reward: -28.096, Step: 300
2023-04-14 23:43:33 - r - INFO: - Episode: 1432/2000, Reward: -97.266, Step: 114
2023-04-14 23:43:41 - r - INFO: - Episode: 1433/2000, Reward: -12.703, Step: 300
2023-04-14 23:43:49 - r - INFO: - Episode: 1434/2000, Reward: 3.788, Step: 300
2023-04-14 23:43:56 - r - INFO: - Episode: 1435/2000, Reward: -16.072, Step: 300
2023-04-14 23:43:57 - r - INFO: - Episode: 1436/2000, Reward: -110.289, Step: 45
2023-04-14 23:44:04 - r - INFO: - Episode: 1437/2000, Reward: -26.409, Step: 300
2023-04-14 23:44:12 - r - INFO: - Episode: 1438/2000, Reward: -28.730, Step: 300
2023-04-14 23:44:19 - r - INFO: - Episode: 1439/2000, Reward: -26.687, Step: 300
2023-04-14 23:44:26 - r - INFO: - Episode: 1440/2000, Reward: -27.394, Step: 300
2023-04-14 23:44:38 - r - INFO: - Episode: 1441/2000, Reward: -21.980, Step: 300
2023-04-14 23:44:53 - r - INFO: - Episode: 1442/2000, Reward: -27.046, Step: 300
2023-04-14 23:45:07 - r - INFO: - Episode: 1443/2000, Reward: -26.475, Step: 300
2023-04-14 23:45:14 - r - INFO: - Episode: 1444/2000, Reward: -26.489, Step: 300
2023-04-14 23:45:16 - r - INFO: - Episode: 1445/2000, Reward: -115.270, Step: 66
2023-04-14 23:45:24 - r - INFO: - Episode: 1446/2000, Reward: 6.981, Step: 300
2023-04-14 23:45:27 - r - INFO: - Episode: 1447/2000, Reward: -96.328, Step: 112
2023-04-14 23:45:36 - r - INFO: - Episode: 1448/2000, Reward: -144.455, Step: 264
2023-04-14 23:45:39 - r - INFO: - Episode: 1449/2000, Reward: -130.940, Step: 104
2023-04-14 23:45:40 - r - INFO: - Episode: 1450/2000, Reward: -110.621, Step: 51
2023-04-14 23:45:43 - r - INFO: - Episode: 1451/2000, Reward: -130.829, Step: 112
2023-04-14 23:45:45 - r - INFO: - Episode: 1452/2000, Reward: -126.768, Step: 74
2023-04-14 23:45:46 - r - INFO: - Episode: 1453/2000, Reward: -102.838, Step: 59
2023-04-14 23:45:51 - r - INFO: - Episode: 1454/2000, Reward: -60.158, Step: 227
2023-04-14 23:45:53 - r - INFO: - Episode: 1455/2000, Reward: -112.175, Step: 72
2023-04-14 23:45:55 - r - INFO: - Episode: 1456/2000, Reward: -104.491, Step: 73
2023-04-14 23:46:01 - r - INFO: - Episode: 1457/2000, Reward: -90.119, Step: 231
2023-04-14 23:46:08 - r - INFO: - Episode: 1458/2000, Reward: -151.743, Step: 273
2023-04-14 23:46:09 - r - INFO: - Episode: 1459/2000, Reward: -124.872, Step: 76
2023-04-14 23:46:17 - r - INFO: - Episode: 1460/2000, Reward: -35.180, Step: 300
2023-04-14 23:46:24 - r - INFO: - Episode: 1461/2000, Reward: -89.136, Step: 135
2023-04-14 23:46:28 - r - INFO: - Episode: 1462/2000, Reward: -115.367, Step: 154
2023-04-14 23:46:31 - r - INFO: - Episode: 1463/2000, Reward: -130.445, Step: 117
2023-04-14 23:46:33 - r - INFO: - Episode: 1464/2000, Reward: -110.058, Step: 80
2023-04-14 23:46:36 - r - INFO: - Episode: 1465/2000, Reward: -113.482, Step: 129
2023-04-14 23:46:43 - r - INFO: - Episode: 1466/2000, Reward: -78.262, Step: 277
2023-04-14 23:46:46 - r - INFO: - Episode: 1467/2000, Reward: -94.361, Step: 151
2023-04-14 23:46:53 - r - INFO: - Episode: 1468/2000, Reward: -6.307, Step: 300
2023-04-14 23:47:00 - r - INFO: - Episode: 1469/2000, Reward: -26.937, Step: 300
2023-04-14 23:47:06 - r - INFO: - Episode: 1470/2000, Reward: -108.564, Step: 248
2023-04-14 23:47:13 - r - INFO: - Episode: 1471/2000, Reward: -12.307, Step: 300
2023-04-14 23:47:15 - r - INFO: - Episode: 1472/2000, Reward: -120.352, Step: 68
2023-04-14 23:47:18 - r - INFO: - Episode: 1473/2000, Reward: -99.203, Step: 138
2023-04-14 23:47:25 - r - INFO: - Episode: 1474/2000, Reward: 7.513, Step: 300
2023-04-14 23:47:33 - r - INFO: - Episode: 1475/2000, Reward: -20.347, Step: 300
2023-04-14 23:47:41 - r - INFO: - Episode: 1476/2000, Reward: 24.684, Step: 300
2023-04-14 23:47:48 - r - INFO: - Episode: 1477/2000, Reward: -10.917, Step: 300
2023-04-14 23:47:50 - r - INFO: - Episode: 1478/2000, Reward: -93.704, Step: 86
2023-04-14 23:47:54 - r - INFO: - Episode: 1479/2000, Reward: -137.090, Step: 189
2023-04-14 23:47:55 - r - INFO: - Episode: 1480/2000, Reward: -109.207, Step: 37
2023-04-14 23:48:11 - r - INFO: - Episode: 1481/2000, Reward: -123.502, Step: 196
2023-04-14 23:48:15 - r - INFO: - Episode: 1482/2000, Reward: -120.611, Step: 123
2023-04-14 23:48:18 - r - INFO: - Episode: 1483/2000, Reward: -104.594, Step: 139
2023-04-14 23:48:25 - r - INFO: - Episode: 1484/2000, Reward: -24.900, Step: 300
2023-04-14 23:48:26 - r - INFO: - Episode: 1485/2000, Reward: -111.124, Step: 46
2023-04-14 23:48:34 - r - INFO: - Episode: 1486/2000, Reward: -29.352, Step: 300
2023-04-14 23:48:40 - r - INFO: - Episode: 1487/2000, Reward: -126.124, Step: 172
2023-04-14 23:48:48 - r - INFO: - Episode: 1488/2000, Reward: -30.163, Step: 300
2023-04-14 23:48:49 - r - INFO: - Episode: 1489/2000, Reward: -107.217, Step: 47
2023-04-14 23:48:56 - r - INFO: - Episode: 1490/2000, Reward: -27.840, Step: 300
2023-04-14 23:49:04 - r - INFO: - Episode: 1491/2000, Reward: -27.757, Step: 300
2023-04-14 23:49:11 - r - INFO: - Episode: 1492/2000, Reward: -35.620, Step: 300
2023-04-14 23:49:18 - r - INFO: - Episode: 1493/2000, Reward: -26.313, Step: 300
2023-04-14 23:49:25 - r - INFO: - Episode: 1494/2000, Reward: -29.084, Step: 300
2023-04-14 23:49:29 - r - INFO: - Episode: 1495/2000, Reward: -100.774, Step: 130
2023-04-14 23:49:31 - r - INFO: - Episode: 1496/2000, Reward: -110.390, Step: 124
2023-04-14 23:49:34 - r - INFO: - Episode: 1497/2000, Reward: -96.995, Step: 108
2023-04-14 23:49:42 - r - INFO: - Episode: 1498/2000, Reward: -26.958, Step: 300
2023-04-14 23:49:49 - r - INFO: - Episode: 1499/2000, Reward: -23.830, Step: 300
2023-04-14 23:49:54 - r - INFO: - Episode: 1500/2000, Reward: -94.691, Step: 249
2023-04-14 23:50:02 - r - INFO: - Episode: 1501/2000, Reward: -90.474, Step: 221
2023-04-14 23:50:04 - r - INFO: - Episode: 1502/2000, Reward: -101.707, Step: 64
2023-04-14 23:50:07 - r - INFO: - Episode: 1503/2000, Reward: -103.440, Step: 121
2023-04-14 23:50:10 - r - INFO: - Episode: 1504/2000, Reward: -111.129, Step: 164
2023-04-14 23:50:17 - r - INFO: - Episode: 1505/2000, Reward: -8.921, Step: 300
2023-04-14 23:50:19 - r - INFO: - Episode: 1506/2000, Reward: -106.919, Step: 85
2023-04-14 23:50:26 - r - INFO: - Episode: 1507/2000, Reward: -21.918, Step: 300
2023-04-14 23:50:33 - r - INFO: - Episode: 1508/2000, Reward: -25.144, Step: 300
2023-04-14 23:50:39 - r - INFO: - Episode: 1509/2000, Reward: -108.917, Step: 216
2023-04-14 23:50:45 - r - INFO: - Episode: 1510/2000, Reward: -120.677, Step: 250
2023-04-14 23:50:48 - r - INFO: - Episode: 1511/2000, Reward: -90.249, Step: 128
2023-04-14 23:50:50 - r - INFO: - Episode: 1512/2000, Reward: -121.198, Step: 75
2023-04-14 23:50:54 - r - INFO: - Episode: 1513/2000, Reward: -92.324, Step: 167
2023-04-14 23:51:01 - r - INFO: - Episode: 1514/2000, Reward: -17.429, Step: 300
2023-04-14 23:51:09 - r - INFO: - Episode: 1515/2000, Reward: -17.293, Step: 300
2023-04-14 23:51:16 - r - INFO: - Episode: 1516/2000, Reward: -11.126, Step: 300
2023-04-14 23:51:23 - r - INFO: - Episode: 1517/2000, Reward: -98.308, Step: 272
2023-04-14 23:51:30 - r - INFO: - Episode: 1518/2000, Reward: -105.741, Step: 249
2023-04-14 23:51:34 - r - INFO: - Episode: 1519/2000, Reward: -98.929, Step: 124
2023-04-14 23:51:37 - r - INFO: - Episode: 1520/2000, Reward: -92.464, Step: 89
2023-04-14 23:51:46 - r - INFO: - Episode: 1521/2000, Reward: -91.097, Step: 145
2023-04-14 23:51:49 - r - INFO: - Episode: 1522/2000, Reward: -100.993, Step: 106
2023-04-14 23:51:56 - r - INFO: - Episode: 1523/2000, Reward: -27.736, Step: 300
2023-04-14 23:52:02 - r - INFO: - Episode: 1524/2000, Reward: -28.411, Step: 300
2023-04-14 23:52:10 - r - INFO: - Episode: 1525/2000, Reward: -25.794, Step: 300
2023-04-14 23:52:15 - r - INFO: - Episode: 1526/2000, Reward: -70.260, Step: 194
2023-04-14 23:52:20 - r - INFO: - Episode: 1527/2000, Reward: -92.581, Step: 205
2023-04-14 23:52:23 - r - INFO: - Episode: 1528/2000, Reward: -89.538, Step: 96
2023-04-14 23:52:26 - r - INFO: - Episode: 1529/2000, Reward: -85.707, Step: 102
2023-04-14 23:52:30 - r - INFO: - Episode: 1530/2000, Reward: -111.472, Step: 175
2023-04-14 23:52:35 - r - INFO: - Episode: 1531/2000, Reward: -80.385, Step: 199
2023-04-14 23:52:37 - r - INFO: - Episode: 1532/2000, Reward: -122.058, Step: 85
2023-04-14 23:52:39 - r - INFO: - Episode: 1533/2000, Reward: -99.985, Step: 60
2023-04-14 23:52:40 - r - INFO: - Episode: 1534/2000, Reward: -101.820, Step: 66
2023-04-14 23:52:43 - r - INFO: - Episode: 1535/2000, Reward: -93.442, Step: 84
2023-04-14 23:52:51 - r - INFO: - Episode: 1536/2000, Reward: 40.521, Step: 300
2023-04-14 23:52:53 - r - INFO: - Episode: 1537/2000, Reward: -96.273, Step: 96
2023-04-14 23:52:58 - r - INFO: - Episode: 1538/2000, Reward: -62.491, Step: 190
2023-04-14 23:53:02 - r - INFO: - Episode: 1539/2000, Reward: -102.136, Step: 131
2023-04-14 23:53:03 - r - INFO: - Episode: 1540/2000, Reward: -102.943, Step: 73
2023-04-14 23:53:14 - r - INFO: - Episode: 1541/2000, Reward: -17.531, Step: 300
2023-04-14 23:53:22 - r - INFO: - Episode: 1542/2000, Reward: -16.506, Step: 300
2023-04-14 23:53:23 - r - INFO: - Episode: 1543/2000, Reward: -101.381, Step: 55
2023-04-14 23:53:30 - r - INFO: - Episode: 1544/2000, Reward: -14.754, Step: 300
2023-04-14 23:53:41 - r - INFO: - Episode: 1545/2000, Reward: -18.075, Step: 300
2023-04-14 23:53:53 - r - INFO: - Episode: 1546/2000, Reward: 0.976, Step: 300
2023-04-14 23:53:57 - r - INFO: - Episode: 1547/2000, Reward: -96.930, Step: 119
2023-04-14 23:54:01 - r - INFO: - Episode: 1548/2000, Reward: -80.451, Step: 154
2023-04-14 23:54:04 - r - INFO: - Episode: 1549/2000, Reward: -96.790, Step: 122
2023-04-14 23:54:06 - r - INFO: - Episode: 1550/2000, Reward: -98.520, Step: 84
2023-04-14 23:54:10 - r - INFO: - Episode: 1551/2000, Reward: -76.315, Step: 167
2023-04-14 23:54:13 - r - INFO: - Episode: 1552/2000, Reward: -103.994, Step: 74
2023-04-14 23:54:21 - r - INFO: - Episode: 1553/2000, Reward: -20.657, Step: 300
2023-04-14 23:54:23 - r - INFO: - Episode: 1554/2000, Reward: -106.576, Step: 81
2023-04-14 23:54:31 - r - INFO: - Episode: 1555/2000, Reward: -27.538, Step: 300
2023-04-14 23:54:32 - r - INFO: - Episode: 1556/2000, Reward: -108.435, Step: 49
2023-04-14 23:54:39 - r - INFO: - Episode: 1557/2000, Reward: -28.201, Step: 300
2023-04-14 23:54:42 - r - INFO: - Episode: 1558/2000, Reward: -107.543, Step: 64
2023-04-14 23:54:44 - r - INFO: - Episode: 1559/2000, Reward: -110.711, Step: 64
2023-04-14 23:54:52 - r - INFO: - Episode: 1560/2000, Reward: -29.906, Step: 300
2023-04-14 23:54:58 - r - INFO: - Episode: 1561/2000, Reward: -97.336, Step: 106
2023-04-14 23:55:04 - r - INFO: - Episode: 1562/2000, Reward: -142.824, Step: 203
2023-04-14 23:55:12 - r - INFO: - Episode: 1563/2000, Reward: -76.496, Step: 286
2023-04-14 23:55:16 - r - INFO: - Episode: 1564/2000, Reward: -94.201, Step: 174
2023-04-14 23:55:21 - r - INFO: - Episode: 1565/2000, Reward: -81.168, Step: 197
2023-04-14 23:55:25 - r - INFO: - Episode: 1566/2000, Reward: -93.734, Step: 120
2023-04-14 23:55:28 - r - INFO: - Episode: 1567/2000, Reward: -87.253, Step: 112
2023-04-14 23:55:32 - r - INFO: - Episode: 1568/2000, Reward: -98.948, Step: 159
2023-04-14 23:55:38 - r - INFO: - Episode: 1569/2000, Reward: -90.996, Step: 189
2023-04-14 23:55:44 - r - INFO: - Episode: 1570/2000, Reward: -91.357, Step: 216
2023-04-14 23:55:48 - r - INFO: - Episode: 1571/2000, Reward: -115.689, Step: 166
2023-04-14 23:55:53 - r - INFO: - Episode: 1572/2000, Reward: -88.660, Step: 174
2023-04-14 23:55:57 - r - INFO: - Episode: 1573/2000, Reward: -85.937, Step: 150
2023-04-14 23:56:05 - r - INFO: - Episode: 1574/2000, Reward: -140.531, Step: 293
2023-04-14 23:56:08 - r - INFO: - Episode: 1575/2000, Reward: -131.591, Step: 130
2023-04-14 23:56:16 - r - INFO: - Episode: 1576/2000, Reward: -22.750, Step: 300
2023-04-14 23:56:18 - r - INFO: - Episode: 1577/2000, Reward: -105.302, Step: 74
2023-04-14 23:56:24 - r - INFO: - Episode: 1578/2000, Reward: -141.659, Step: 204
2023-04-14 23:56:26 - r - INFO: - Episode: 1579/2000, Reward: -108.212, Step: 66
2023-04-14 23:56:30 - r - INFO: - Episode: 1580/2000, Reward: -105.870, Step: 140
2023-04-14 23:56:37 - r - INFO: - Episode: 1581/2000, Reward: -94.862, Step: 152
2023-04-14 23:56:40 - r - INFO: - Episode: 1582/2000, Reward: -104.274, Step: 78
2023-04-14 23:56:44 - r - INFO: - Episode: 1583/2000, Reward: -97.254, Step: 134
2023-04-14 23:56:47 - r - INFO: - Episode: 1584/2000, Reward: -102.063, Step: 75
2023-04-14 23:56:51 - r - INFO: - Episode: 1585/2000, Reward: -85.375, Step: 122
2023-04-14 23:56:54 - r - INFO: - Episode: 1586/2000, Reward: -84.339, Step: 131
2023-04-14 23:56:57 - r - INFO: - Episode: 1587/2000, Reward: -112.335, Step: 98
2023-04-14 23:57:02 - r - INFO: - Episode: 1588/2000, Reward: -132.734, Step: 182
2023-04-14 23:57:07 - r - INFO: - Episode: 1589/2000, Reward: -91.823, Step: 126
2023-04-14 23:57:10 - r - INFO: - Episode: 1590/2000, Reward: -87.269, Step: 95
2023-04-14 23:57:12 - r - INFO: - Episode: 1591/2000, Reward: -102.590, Step: 59
2023-04-14 23:57:17 - r - INFO: - Episode: 1592/2000, Reward: -89.026, Step: 204
2023-04-14 23:57:22 - r - INFO: - Episode: 1593/2000, Reward: -90.021, Step: 151
2023-04-14 23:57:24 - r - INFO: - Episode: 1594/2000, Reward: -109.770, Step: 98
2023-04-14 23:57:27 - r - INFO: - Episode: 1595/2000, Reward: -109.446, Step: 105
2023-04-14 23:57:38 - r - INFO: - Episode: 1596/2000, Reward: -24.777, Step: 300
2023-04-14 23:57:43 - r - INFO: - Episode: 1597/2000, Reward: -83.534, Step: 181
2023-04-14 23:57:49 - r - INFO: - Episode: 1598/2000, Reward: -78.544, Step: 158
2023-04-14 23:57:53 - r - INFO: - Episode: 1599/2000, Reward: -103.939, Step: 161
2023-04-14 23:57:57 - r - INFO: - Episode: 1600/2000, Reward: -93.903, Step: 109
2023-04-14 23:58:03 - r - INFO: - Episode: 1601/2000, Reward: -93.734, Step: 100
2023-04-14 23:58:09 - r - INFO: - Episode: 1602/2000, Reward: -132.966, Step: 212
2023-04-14 23:58:15 - r - INFO: - Episode: 1603/2000, Reward: -77.269, Step: 205
2023-04-14 23:58:16 - r - INFO: - Episode: 1604/2000, Reward: -104.734, Step: 60
2023-04-14 23:58:18 - r - INFO: - Episode: 1605/2000, Reward: -103.968, Step: 73
2023-04-14 23:58:21 - r - INFO: - Episode: 1606/2000, Reward: -99.054, Step: 103
2023-04-14 23:58:23 - r - INFO: - Episode: 1607/2000, Reward: -105.919, Step: 83
2023-04-14 23:58:26 - r - INFO: - Episode: 1608/2000, Reward: -81.760, Step: 124
2023-04-14 23:58:29 - r - INFO: - Episode: 1609/2000, Reward: -128.163, Step: 97
2023-04-14 23:58:31 - r - INFO: - Episode: 1610/2000, Reward: -100.209, Step: 66
2023-04-14 23:58:33 - r - INFO: - Episode: 1611/2000, Reward: -100.396, Step: 70
2023-04-14 23:58:35 - r - INFO: - Episode: 1612/2000, Reward: -99.005, Step: 71
2023-04-14 23:58:37 - r - INFO: - Episode: 1613/2000, Reward: -101.131, Step: 55
2023-04-14 23:58:42 - r - INFO: - Episode: 1614/2000, Reward: -128.337, Step: 101
2023-04-14 23:58:44 - r - INFO: - Episode: 1615/2000, Reward: -102.811, Step: 51
2023-04-14 23:58:46 - r - INFO: - Episode: 1616/2000, Reward: -97.280, Step: 96
2023-04-14 23:58:48 - r - INFO: - Episode: 1617/2000, Reward: -96.040, Step: 74
2023-04-14 23:58:50 - r - INFO: - Episode: 1618/2000, Reward: -109.229, Step: 53
2023-04-14 23:58:52 - r - INFO: - Episode: 1619/2000, Reward: -108.900, Step: 70
2023-04-14 23:58:55 - r - INFO: - Episode: 1620/2000, Reward: -80.517, Step: 127
2023-04-14 23:58:57 - r - INFO: - Episode: 1621/2000, Reward: -107.586, Step: 62
2023-04-14 23:58:59 - r - INFO: - Episode: 1622/2000, Reward: -107.888, Step: 77
2023-04-14 23:59:02 - r - INFO: - Episode: 1623/2000, Reward: -104.494, Step: 120
2023-04-14 23:59:07 - r - INFO: - Episode: 1624/2000, Reward: -84.380, Step: 180
2023-04-14 23:59:13 - r - INFO: - Episode: 1625/2000, Reward: -133.468, Step: 240
2023-04-14 23:59:20 - r - INFO: - Episode: 1626/2000, Reward: -5.745, Step: 300
2023-04-14 23:59:28 - r - INFO: - Episode: 1627/2000, Reward: -40.514, Step: 300
2023-04-14 23:59:31 - r - INFO: - Episode: 1628/2000, Reward: -132.635, Step: 138
2023-04-14 23:59:33 - r - INFO: - Episode: 1629/2000, Reward: -114.595, Step: 80
2023-04-14 23:59:41 - r - INFO: - Episode: 1630/2000, Reward: -26.309, Step: 300
2023-04-14 23:59:46 - r - INFO: - Episode: 1631/2000, Reward: -132.440, Step: 175
2023-04-14 23:59:50 - r - INFO: - Episode: 1632/2000, Reward: -96.398, Step: 150
2023-04-14 23:59:58 - r - INFO: - Episode: 1633/2000, Reward: -29.424, Step: 300
2023-04-15 00:00:01 - r - INFO: - Episode: 1634/2000, Reward: -95.548, Step: 123
2023-04-15 00:00:09 - r - INFO: - Episode: 1635/2000, Reward: 1.055, Step: 300
2023-04-15 00:00:11 - r - INFO: - Episode: 1636/2000, Reward: -111.914, Step: 61
2023-04-15 00:00:13 - r - INFO: - Episode: 1637/2000, Reward: -117.578, Step: 65
2023-04-15 00:00:17 - r - INFO: - Episode: 1638/2000, Reward: -97.123, Step: 175
2023-04-15 00:00:25 - r - INFO: - Episode: 1639/2000, Reward: -44.868, Step: 300
2023-04-15 00:00:27 - r - INFO: - Episode: 1640/2000, Reward: -116.705, Step: 84
2023-04-15 00:00:34 - r - INFO: - Episode: 1641/2000, Reward: -87.088, Step: 157
2023-04-15 00:00:35 - r - INFO: - Episode: 1642/2000, Reward: -103.817, Step: 73
2023-04-15 00:00:40 - r - INFO: - Episode: 1643/2000, Reward: -79.229, Step: 179
2023-04-15 00:00:46 - r - INFO: - Episode: 1644/2000, Reward: -142.435, Step: 262
2023-04-15 00:00:49 - r - INFO: - Episode: 1645/2000, Reward: -90.249, Step: 130
2023-04-15 00:00:56 - r - INFO: - Episode: 1646/2000, Reward: -122.482, Step: 247
2023-04-15 00:00:58 - r - INFO: - Episode: 1647/2000, Reward: -108.038, Step: 80
2023-04-15 00:01:00 - r - INFO: - Episode: 1648/2000, Reward: -108.627, Step: 83
2023-04-15 00:01:03 - r - INFO: - Episode: 1649/2000, Reward: -123.984, Step: 109
2023-04-15 00:01:06 - r - INFO: - Episode: 1650/2000, Reward: -105.913, Step: 120
2023-04-15 00:01:14 - r - INFO: - Episode: 1651/2000, Reward: -11.996, Step: 300
2023-04-15 00:01:20 - r - INFO: - Episode: 1652/2000, Reward: -103.465, Step: 236
2023-04-15 00:01:28 - r - INFO: - Episode: 1653/2000, Reward: -12.042, Step: 300
2023-04-15 00:01:32 - r - INFO: - Episode: 1654/2000, Reward: -92.671, Step: 159
2023-04-15 00:01:33 - r - INFO: - Episode: 1655/2000, Reward: -104.026, Step: 49
2023-04-15 00:01:41 - r - INFO: - Episode: 1656/2000, Reward: -16.799, Step: 300
2023-04-15 00:01:51 - r - INFO: - Episode: 1657/2000, Reward: -2.646, Step: 300
2023-04-15 00:01:55 - r - INFO: - Episode: 1658/2000, Reward: -81.524, Step: 137
2023-04-15 00:01:58 - r - INFO: - Episode: 1659/2000, Reward: -97.058, Step: 89
2023-04-15 00:02:00 - r - INFO: - Episode: 1660/2000, Reward: -92.083, Step: 95
2023-04-15 00:02:04 - r - INFO: - Episode: 1661/2000, Reward: -87.654, Step: 92
2023-04-15 00:02:07 - r - INFO: - Episode: 1662/2000, Reward: -92.996, Step: 130
2023-04-15 00:02:09 - r - INFO: - Episode: 1663/2000, Reward: -107.783, Step: 83
2023-04-15 00:02:10 - r - INFO: - Episode: 1664/2000, Reward: -104.025, Step: 65
2023-04-15 00:02:18 - r - INFO: - Episode: 1665/2000, Reward: -9.261, Step: 300
2023-04-15 00:02:26 - r - INFO: - Episode: 1666/2000, Reward: 47.409, Step: 300
2023-04-15 00:02:32 - r - INFO: - Episode: 1667/2000, Reward: -50.270, Step: 276
2023-04-15 00:02:35 - r - INFO: - Episode: 1668/2000, Reward: -88.053, Step: 122
2023-04-15 00:02:37 - r - INFO: - Episode: 1669/2000, Reward: -103.125, Step: 70
2023-04-15 00:02:39 - r - INFO: - Episode: 1670/2000, Reward: -88.872, Step: 98
2023-04-15 00:02:42 - r - INFO: - Episode: 1671/2000, Reward: -88.886, Step: 99
2023-04-15 00:02:46 - r - INFO: - Episode: 1672/2000, Reward: -69.494, Step: 167
2023-04-15 00:02:48 - r - INFO: - Episode: 1673/2000, Reward: -105.505, Step: 60
2023-04-15 00:02:50 - r - INFO: - Episode: 1674/2000, Reward: -98.870, Step: 67
2023-04-15 00:02:52 - r - INFO: - Episode: 1675/2000, Reward: -97.579, Step: 114
2023-04-15 00:02:56 - r - INFO: - Episode: 1676/2000, Reward: -88.303, Step: 117
2023-04-15 00:03:01 - r - INFO: - Episode: 1677/2000, Reward: -64.094, Step: 207
2023-04-15 00:03:03 - r - INFO: - Episode: 1678/2000, Reward: -102.119, Step: 63
2023-04-15 00:03:05 - r - INFO: - Episode: 1679/2000, Reward: -99.614, Step: 69
2023-04-15 00:03:09 - r - INFO: - Episode: 1680/2000, Reward: -59.398, Step: 172
2023-04-15 00:03:15 - r - INFO: - Current episode 1680 has the best eval reward: 53.515
2023-04-15 00:03:18 - r - INFO: - Episode: 1681/2000, Reward: -89.579, Step: 123
2023-04-15 00:03:22 - r - INFO: - Episode: 1682/2000, Reward: -62.235, Step: 161
2023-04-15 00:03:24 - r - INFO: - Episode: 1683/2000, Reward: -102.677, Step: 58
2023-04-15 00:03:26 - r - INFO: - Episode: 1684/2000, Reward: -97.238, Step: 78
2023-04-15 00:03:27 - r - INFO: - Episode: 1685/2000, Reward: -106.710, Step: 50
2023-04-15 00:03:30 - r - INFO: - Episode: 1686/2000, Reward: -97.837, Step: 95
2023-04-15 00:03:31 - r - INFO: - Episode: 1687/2000, Reward: -102.352, Step: 55
2023-04-15 00:03:35 - r - INFO: - Episode: 1688/2000, Reward: -85.641, Step: 114
2023-04-15 00:03:38 - r - INFO: - Episode: 1689/2000, Reward: -96.939, Step: 98
2023-04-15 00:03:46 - r - INFO: - Episode: 1690/2000, Reward: -61.829, Step: 240
2023-04-15 00:03:53 - r - INFO: - Episode: 1691/2000, Reward: -68.257, Step: 253
2023-04-15 00:03:57 - r - INFO: - Episode: 1692/2000, Reward: -86.823, Step: 137
2023-04-15 00:04:01 - r - INFO: - Episode: 1693/2000, Reward: -89.768, Step: 136
2023-04-15 00:04:02 - r - INFO: - Episode: 1694/2000, Reward: -104.367, Step: 58
2023-04-15 00:04:11 - r - INFO: - Episode: 1695/2000, Reward: 41.988, Step: 300
2023-04-15 00:04:18 - r - INFO: - Episode: 1696/2000, Reward: -70.874, Step: 226
2023-04-15 00:04:22 - r - INFO: - Episode: 1697/2000, Reward: -94.115, Step: 146
2023-04-15 00:04:29 - r - INFO: - Episode: 1698/2000, Reward: 57.150, Step: 300
2023-04-15 00:04:31 - r - INFO: - Episode: 1699/2000, Reward: -104.660, Step: 64
2023-04-15 00:04:33 - r - INFO: - Episode: 1700/2000, Reward: -99.207, Step: 74
2023-04-15 00:04:46 - r - INFO: - Episode: 1701/2000, Reward: 30.261, Step: 300
2023-04-15 00:04:49 - r - INFO: - Episode: 1702/2000, Reward: -82.093, Step: 140
2023-04-15 00:04:51 - r - INFO: - Episode: 1703/2000, Reward: -104.120, Step: 64
2023-04-15 00:04:53 - r - INFO: - Episode: 1704/2000, Reward: -105.247, Step: 49
2023-04-15 00:04:56 - r - INFO: - Episode: 1705/2000, Reward: -100.014, Step: 79
2023-04-15 00:04:59 - r - INFO: - Episode: 1706/2000, Reward: -86.230, Step: 144
2023-04-15 00:05:02 - r - INFO: - Episode: 1707/2000, Reward: -86.790, Step: 102
2023-04-15 00:05:04 - r - INFO: - Episode: 1708/2000, Reward: -112.001, Step: 75
2023-04-15 00:05:06 - r - INFO: - Episode: 1709/2000, Reward: -110.014, Step: 80
2023-04-15 00:05:10 - r - INFO: - Episode: 1710/2000, Reward: -86.361, Step: 179
2023-04-15 00:05:15 - r - INFO: - Episode: 1711/2000, Reward: -64.496, Step: 196
2023-04-15 00:05:17 - r - INFO: - Episode: 1712/2000, Reward: -100.213, Step: 92
2023-04-15 00:05:19 - r - INFO: - Episode: 1713/2000, Reward: -96.016, Step: 85
2023-04-15 00:05:21 - r - INFO: - Episode: 1714/2000, Reward: -86.865, Step: 100
2023-04-15 00:05:24 - r - INFO: - Episode: 1715/2000, Reward: -95.740, Step: 126
2023-04-15 00:05:26 - r - INFO: - Episode: 1716/2000, Reward: -101.461, Step: 64
2023-04-15 00:05:28 - r - INFO: - Episode: 1717/2000, Reward: -91.661, Step: 117
2023-04-15 00:05:33 - r - INFO: - Episode: 1718/2000, Reward: -98.622, Step: 182
2023-04-15 00:05:40 - r - INFO: - Episode: 1719/2000, Reward: 39.557, Step: 300
2023-04-15 00:05:45 - r - INFO: - Episode: 1720/2000, Reward: -70.805, Step: 212
2023-04-15 00:05:49 - r - INFO: - Current episode 1720 has the best eval reward: 56.122
2023-04-15 00:05:53 - r - INFO: - Episode: 1721/2000, Reward: -89.341, Step: 161
2023-04-15 00:05:59 - r - INFO: - Episode: 1722/2000, Reward: -101.353, Step: 201
2023-04-15 00:06:00 - r - INFO: - Episode: 1723/2000, Reward: -100.031, Step: 69
2023-04-15 00:06:06 - r - INFO: - Episode: 1724/2000, Reward: -68.393, Step: 255
2023-04-15 00:06:09 - r - INFO: - Episode: 1725/2000, Reward: -76.573, Step: 127
2023-04-15 00:06:11 - r - INFO: - Episode: 1726/2000, Reward: -112.782, Step: 74
2023-04-15 00:06:13 - r - INFO: - Episode: 1727/2000, Reward: -106.070, Step: 97
2023-04-15 00:06:16 - r - INFO: - Episode: 1728/2000, Reward: -99.428, Step: 106
2023-04-15 00:06:19 - r - INFO: - Episode: 1729/2000, Reward: -107.613, Step: 114
2023-04-15 00:06:26 - r - INFO: - Episode: 1730/2000, Reward: 41.436, Step: 300
2023-04-15 00:06:31 - r - INFO: - Episode: 1731/2000, Reward: -87.882, Step: 207
2023-04-15 00:06:37 - r - INFO: - Episode: 1732/2000, Reward: -74.285, Step: 258
2023-04-15 00:06:40 - r - INFO: - Episode: 1733/2000, Reward: -93.796, Step: 133
2023-04-15 00:06:42 - r - INFO: - Episode: 1734/2000, Reward: -83.045, Step: 107
2023-04-15 00:06:48 - r - INFO: - Episode: 1735/2000, Reward: -73.644, Step: 238
2023-04-15 00:06:50 - r - INFO: - Episode: 1736/2000, Reward: -104.826, Step: 60
2023-04-15 00:06:55 - r - INFO: - Episode: 1737/2000, Reward: -102.129, Step: 255
2023-04-15 00:06:59 - r - INFO: - Episode: 1738/2000, Reward: -99.139, Step: 129
2023-04-15 00:07:00 - r - INFO: - Episode: 1739/2000, Reward: -103.643, Step: 52
2023-04-15 00:07:07 - r - INFO: - Episode: 1740/2000, Reward: 29.909, Step: 300
2023-04-15 00:07:16 - r - INFO: - Episode: 1741/2000, Reward: -73.207, Step: 170
2023-04-15 00:07:23 - r - INFO: - Episode: 1742/2000, Reward: -20.468, Step: 300
2023-04-15 00:07:26 - r - INFO: - Episode: 1743/2000, Reward: -92.957, Step: 93
2023-04-15 00:07:33 - r - INFO: - Episode: 1744/2000, Reward: 3.198, Step: 300
2023-04-15 00:07:40 - r - INFO: - Episode: 1745/2000, Reward: 15.467, Step: 300
2023-04-15 00:07:44 - r - INFO: - Episode: 1746/2000, Reward: -92.289, Step: 183
2023-04-15 00:07:49 - r - INFO: - Episode: 1747/2000, Reward: -119.665, Step: 207
2023-04-15 00:07:56 - r - INFO: - Episode: 1748/2000, Reward: -73.254, Step: 290
2023-04-15 00:08:01 - r - INFO: - Episode: 1749/2000, Reward: -90.237, Step: 211
2023-04-15 00:08:03 - r - INFO: - Episode: 1750/2000, Reward: -120.427, Step: 84
2023-04-15 00:08:05 - r - INFO: - Episode: 1751/2000, Reward: -128.761, Step: 84
2023-04-15 00:08:12 - r - INFO: - Episode: 1752/2000, Reward: -94.312, Step: 248
2023-04-15 00:08:17 - r - INFO: - Episode: 1753/2000, Reward: -91.325, Step: 196
2023-04-15 00:08:23 - r - INFO: - Episode: 1754/2000, Reward: -62.706, Step: 260
2023-04-15 00:08:30 - r - INFO: - Episode: 1755/2000, Reward: -65.807, Step: 290
2023-04-15 00:08:34 - r - INFO: - Episode: 1756/2000, Reward: -71.119, Step: 184
2023-04-15 00:08:37 - r - INFO: - Episode: 1757/2000, Reward: -80.588, Step: 121
2023-04-15 00:08:41 - r - INFO: - Episode: 1758/2000, Reward: -80.505, Step: 161
2023-04-15 00:08:46 - r - INFO: - Episode: 1759/2000, Reward: -65.625, Step: 183
2023-04-15 00:08:50 - r - INFO: - Episode: 1760/2000, Reward: -90.121, Step: 130
2023-04-15 00:08:56 - r - INFO: - Episode: 1761/2000, Reward: -80.820, Step: 121
2023-04-15 00:09:03 - r - INFO: - Episode: 1762/2000, Reward: -80.713, Step: 271
2023-04-15 00:09:06 - r - INFO: - Episode: 1763/2000, Reward: -100.195, Step: 102
2023-04-15 00:09:07 - r - INFO: - Episode: 1764/2000, Reward: -100.942, Step: 86
2023-04-15 00:09:13 - r - INFO: - Episode: 1765/2000, Reward: -102.758, Step: 223
2023-04-15 00:09:21 - r - INFO: - Episode: 1766/2000, Reward: -29.068, Step: 300
2023-04-15 00:09:27 - r - INFO: - Episode: 1767/2000, Reward: -141.406, Step: 234
2023-04-15 00:09:30 - r - INFO: - Episode: 1768/2000, Reward: -82.553, Step: 160
2023-04-15 00:09:35 - r - INFO: - Episode: 1769/2000, Reward: -120.422, Step: 196
2023-04-15 00:09:42 - r - INFO: - Episode: 1770/2000, Reward: 22.906, Step: 300
2023-04-15 00:09:45 - r - INFO: - Episode: 1771/2000, Reward: -100.440, Step: 105
2023-04-15 00:09:52 - r - INFO: - Episode: 1772/2000, Reward: -5.520, Step: 300
2023-04-15 00:09:59 - r - INFO: - Episode: 1773/2000, Reward: -24.523, Step: 300
2023-04-15 00:10:06 - r - INFO: - Episode: 1774/2000, Reward: -9.319, Step: 300
2023-04-15 00:10:13 - r - INFO: - Episode: 1775/2000, Reward: -21.726, Step: 300
2023-04-15 00:10:21 - r - INFO: - Episode: 1776/2000, Reward: -9.632, Step: 300
2023-04-15 00:10:28 - r - INFO: - Episode: 1777/2000, Reward: -7.421, Step: 300
2023-04-15 00:10:35 - r - INFO: - Episode: 1778/2000, Reward: -11.634, Step: 300
2023-04-15 00:10:42 - r - INFO: - Episode: 1779/2000, Reward: -2.312, Step: 300
2023-04-15 00:10:49 - r - INFO: - Episode: 1780/2000, Reward: -11.084, Step: 300
2023-04-15 00:11:00 - r - INFO: - Episode: 1781/2000, Reward: -104.991, Step: 281
2023-04-15 00:11:08 - r - INFO: - Episode: 1782/2000, Reward: -86.802, Step: 289
2023-04-15 00:11:12 - r - INFO: - Episode: 1783/2000, Reward: -127.547, Step: 185
2023-04-15 00:11:16 - r - INFO: - Episode: 1784/2000, Reward: -107.168, Step: 127
2023-04-15 00:11:20 - r - INFO: - Episode: 1785/2000, Reward: -98.529, Step: 142
2023-04-15 00:11:23 - r - INFO: - Episode: 1786/2000, Reward: -94.260, Step: 142
2023-04-15 00:11:26 - r - INFO: - Episode: 1787/2000, Reward: -110.836, Step: 87
2023-04-15 00:11:33 - r - INFO: - Episode: 1788/2000, Reward: 28.547, Step: 300
2023-04-15 00:11:35 - r - INFO: - Episode: 1789/2000, Reward: -97.462, Step: 83
2023-04-15 00:11:43 - r - INFO: - Episode: 1790/2000, Reward: 29.889, Step: 300
2023-04-15 00:11:49 - r - INFO: - Episode: 1791/2000, Reward: -70.733, Step: 242
2023-04-15 00:11:56 - r - INFO: - Episode: 1792/2000, Reward: 16.171, Step: 300
2023-04-15 00:12:04 - r - INFO: - Episode: 1793/2000, Reward: 31.374, Step: 300
2023-04-15 00:12:11 - r - INFO: - Episode: 1794/2000, Reward: -86.126, Step: 282
2023-04-15 00:12:15 - r - INFO: - Episode: 1795/2000, Reward: -84.053, Step: 179
2023-04-15 00:12:23 - r - INFO: - Episode: 1796/2000, Reward: -17.374, Step: 300
2023-04-15 00:12:30 - r - INFO: - Episode: 1797/2000, Reward: -24.306, Step: 300
2023-04-15 00:12:37 - r - INFO: - Episode: 1798/2000, Reward: -24.019, Step: 300
2023-04-15 00:12:44 - r - INFO: - Episode: 1799/2000, Reward: -22.826, Step: 300
2023-04-15 00:12:51 - r - INFO: - Episode: 1800/2000, Reward: -20.573, Step: 300
2023-04-15 00:13:02 - r - INFO: - Episode: 1801/2000, Reward: -23.272, Step: 300
2023-04-15 00:13:11 - r - INFO: - Episode: 1802/2000, Reward: -17.575, Step: 300
2023-04-15 00:13:15 - r - INFO: - Episode: 1803/2000, Reward: -73.650, Step: 171
2023-04-15 00:13:18 - r - INFO: - Episode: 1804/2000, Reward: -97.588, Step: 131
2023-04-15 00:13:21 - r - INFO: - Episode: 1805/2000, Reward: -93.526, Step: 118
2023-04-15 00:13:29 - r - INFO: - Episode: 1806/2000, Reward: 48.846, Step: 300
2023-04-15 00:13:33 - r - INFO: - Episode: 1807/2000, Reward: -82.671, Step: 122
2023-04-15 00:13:41 - r - INFO: - Episode: 1808/2000, Reward: -56.194, Step: 288
2023-04-15 00:13:50 - r - INFO: - Episode: 1809/2000, Reward: -61.554, Step: 259
2023-04-15 00:13:53 - r - INFO: - Episode: 1810/2000, Reward: -96.778, Step: 109
2023-04-15 00:13:59 - r - INFO: - Episode: 1811/2000, Reward: -75.172, Step: 253
2023-04-15 00:14:04 - r - INFO: - Episode: 1812/2000, Reward: -87.951, Step: 156
2023-04-15 00:14:08 - r - INFO: - Episode: 1813/2000, Reward: -89.942, Step: 143
2023-04-15 00:14:12 - r - INFO: - Episode: 1814/2000, Reward: -90.063, Step: 141
2023-04-15 00:14:20 - r - INFO: - Episode: 1815/2000, Reward: 54.694, Step: 300
2023-04-15 00:14:26 - r - INFO: - Episode: 1816/2000, Reward: -59.706, Step: 217
2023-04-15 00:14:35 - r - INFO: - Episode: 1817/2000, Reward: 45.015, Step: 300
2023-04-15 00:14:46 - r - INFO: - Episode: 1818/2000, Reward: 21.661, Step: 300
2023-04-15 00:14:51 - r - INFO: - Episode: 1819/2000, Reward: -95.580, Step: 100
2023-04-15 00:14:57 - r - INFO: - Episode: 1820/2000, Reward: -74.743, Step: 219
2023-04-15 00:15:06 - r - INFO: - Episode: 1821/2000, Reward: -109.499, Step: 120
2023-04-15 00:15:09 - r - INFO: - Episode: 1822/2000, Reward: -112.940, Step: 87
2023-04-15 00:15:14 - r - INFO: - Episode: 1823/2000, Reward: -112.801, Step: 217
2023-04-15 00:15:17 - r - INFO: - Episode: 1824/2000, Reward: -126.671, Step: 127
2023-04-15 00:15:20 - r - INFO: - Episode: 1825/2000, Reward: -119.509, Step: 69
2023-04-15 00:15:25 - r - INFO: - Episode: 1826/2000, Reward: -77.625, Step: 165
2023-04-15 00:15:28 - r - INFO: - Episode: 1827/2000, Reward: -115.646, Step: 106
2023-04-15 00:15:36 - r - INFO: - Episode: 1828/2000, Reward: -27.810, Step: 300
2023-04-15 00:15:38 - r - INFO: - Episode: 1829/2000, Reward: -111.801, Step: 70
2023-04-15 00:15:45 - r - INFO: - Episode: 1830/2000, Reward: 11.284, Step: 300
2023-04-15 00:15:48 - r - INFO: - Episode: 1831/2000, Reward: -109.162, Step: 95
2023-04-15 00:15:50 - r - INFO: - Episode: 1832/2000, Reward: -113.146, Step: 79
2023-04-15 00:15:57 - r - INFO: - Episode: 1833/2000, Reward: 28.371, Step: 300
2023-04-15 00:16:04 - r - INFO: - Episode: 1834/2000, Reward: -2.006, Step: 300
2023-04-15 00:16:12 - r - INFO: - Episode: 1835/2000, Reward: -9.489, Step: 300
2023-04-15 00:16:18 - r - INFO: - Episode: 1836/2000, Reward: -137.604, Step: 242
2023-04-15 00:16:24 - r - INFO: - Episode: 1837/2000, Reward: -105.284, Step: 243
2023-04-15 00:16:31 - r - INFO: - Episode: 1838/2000, Reward: -33.606, Step: 300
2023-04-15 00:16:39 - r - INFO: - Episode: 1839/2000, Reward: -33.458, Step: 300
2023-04-15 00:16:42 - r - INFO: - Episode: 1840/2000, Reward: -117.226, Step: 135
2023-04-15 00:16:57 - r - INFO: - Episode: 1841/2000, Reward: -28.383, Step: 300
2023-04-15 00:17:09 - r - INFO: - Episode: 1842/2000, Reward: -28.678, Step: 300
2023-04-15 00:17:13 - r - INFO: - Episode: 1843/2000, Reward: -87.896, Step: 158
2023-04-15 00:17:21 - r - INFO: - Episode: 1844/2000, Reward: -25.369, Step: 300
2023-04-15 00:17:27 - r - INFO: - Episode: 1845/2000, Reward: -72.367, Step: 208
2023-04-15 00:17:32 - r - INFO: - Episode: 1846/2000, Reward: -70.552, Step: 236
2023-04-15 00:17:34 - r - INFO: - Episode: 1847/2000, Reward: -104.235, Step: 53
2023-04-15 00:17:41 - r - INFO: - Episode: 1848/2000, Reward: -15.926, Step: 300
2023-04-15 00:17:47 - r - INFO: - Episode: 1849/2000, Reward: -83.208, Step: 253
2023-04-15 00:17:52 - r - INFO: - Episode: 1850/2000, Reward: -83.722, Step: 214
2023-04-15 00:17:53 - r - INFO: - Episode: 1851/2000, Reward: -102.572, Step: 51
2023-04-15 00:17:57 - r - INFO: - Episode: 1852/2000, Reward: -98.576, Step: 182
2023-04-15 00:18:00 - r - INFO: - Episode: 1853/2000, Reward: -93.727, Step: 108
2023-04-15 00:18:05 - r - INFO: - Episode: 1854/2000, Reward: -82.409, Step: 212
2023-04-15 00:18:12 - r - INFO: - Episode: 1855/2000, Reward: -106.064, Step: 238
2023-04-15 00:18:15 - r - INFO: - Episode: 1856/2000, Reward: -108.820, Step: 123
2023-04-15 00:18:22 - r - INFO: - Episode: 1857/2000, Reward: 27.341, Step: 300
2023-04-15 00:18:30 - r - INFO: - Episode: 1858/2000, Reward: 2.342, Step: 300
2023-04-15 00:18:34 - r - INFO: - Episode: 1859/2000, Reward: -112.361, Step: 202
2023-04-15 00:18:36 - r - INFO: - Episode: 1860/2000, Reward: -122.982, Step: 81
2023-04-15 00:18:43 - r - INFO: - Episode: 1861/2000, Reward: -93.719, Step: 115
2023-04-15 00:18:52 - r - INFO: - Episode: 1862/2000, Reward: 12.245, Step: 300
2023-04-15 00:18:57 - r - INFO: - Episode: 1863/2000, Reward: -78.408, Step: 172
2023-04-15 00:18:58 - r - INFO: - Episode: 1864/2000, Reward: -113.425, Step: 63
2023-04-15 00:19:02 - r - INFO: - Episode: 1865/2000, Reward: -79.532, Step: 156
2023-04-15 00:19:07 - r - INFO: - Episode: 1866/2000, Reward: -90.992, Step: 217
2023-04-15 00:19:09 - r - INFO: - Episode: 1867/2000, Reward: -111.185, Step: 61
2023-04-15 00:19:16 - r - INFO: - Episode: 1868/2000, Reward: 24.979, Step: 300
2023-04-15 00:19:18 - r - INFO: - Episode: 1869/2000, Reward: -116.713, Step: 66
2023-04-15 00:19:22 - r - INFO: - Episode: 1870/2000, Reward: -83.690, Step: 156
2023-04-15 00:19:25 - r - INFO: - Episode: 1871/2000, Reward: -88.495, Step: 149
2023-04-15 00:19:29 - r - INFO: - Episode: 1872/2000, Reward: -99.786, Step: 173
2023-04-15 00:19:33 - r - INFO: - Episode: 1873/2000, Reward: -84.629, Step: 167
2023-04-15 00:19:36 - r - INFO: - Episode: 1874/2000, Reward: -92.375, Step: 108
2023-04-15 00:19:37 - r - INFO: - Episode: 1875/2000, Reward: -119.302, Step: 83
2023-04-15 00:19:40 - r - INFO: - Episode: 1876/2000, Reward: -88.128, Step: 114
2023-04-15 00:19:43 - r - INFO: - Episode: 1877/2000, Reward: -84.368, Step: 135
2023-04-15 00:19:48 - r - INFO: - Episode: 1878/2000, Reward: -70.568, Step: 184
2023-04-15 00:19:51 - r - INFO: - Episode: 1879/2000, Reward: -77.444, Step: 152
2023-04-15 00:19:53 - r - INFO: - Episode: 1880/2000, Reward: -96.379, Step: 97
2023-04-15 00:19:58 - r - INFO: - Episode: 1881/2000, Reward: -90.598, Step: 112
2023-04-15 00:20:02 - r - INFO: - Episode: 1882/2000, Reward: -81.191, Step: 165
2023-04-15 00:20:07 - r - INFO: - Episode: 1883/2000, Reward: -88.334, Step: 209
2023-04-15 00:20:15 - r - INFO: - Episode: 1884/2000, Reward: -5.908, Step: 300
2023-04-15 00:20:17 - r - INFO: - Episode: 1885/2000, Reward: -107.063, Step: 124
2023-04-15 00:20:22 - r - INFO: - Episode: 1886/2000, Reward: -86.158, Step: 203
2023-04-15 00:20:25 - r - INFO: - Episode: 1887/2000, Reward: -99.931, Step: 111
2023-04-15 00:20:32 - r - INFO: - Episode: 1888/2000, Reward: 43.878, Step: 300
2023-04-15 00:20:41 - r - INFO: - Episode: 1889/2000, Reward: -4.982, Step: 300
2023-04-15 00:20:48 - r - INFO: - Episode: 1890/2000, Reward: 31.698, Step: 300
2023-04-15 00:20:55 - r - INFO: - Episode: 1891/2000, Reward: 19.363, Step: 300
2023-04-15 00:20:58 - r - INFO: - Episode: 1892/2000, Reward: -97.358, Step: 150
2023-04-15 00:21:06 - r - INFO: - Episode: 1893/2000, Reward: 24.101, Step: 300
2023-04-15 00:21:13 - r - INFO: - Episode: 1894/2000, Reward: 19.375, Step: 300
2023-04-15 00:21:20 - r - INFO: - Episode: 1895/2000, Reward: -84.976, Step: 283
2023-04-15 00:21:27 - r - INFO: - Episode: 1896/2000, Reward: 5.222, Step: 300
2023-04-15 00:21:30 - r - INFO: - Episode: 1897/2000, Reward: -104.016, Step: 117
2023-04-15 00:21:33 - r - INFO: - Episode: 1898/2000, Reward: -107.411, Step: 115
2023-04-15 00:21:40 - r - INFO: - Episode: 1899/2000, Reward: 20.589, Step: 300
2023-04-15 00:21:47 - r - INFO: - Episode: 1900/2000, Reward: 18.925, Step: 300
2023-04-15 00:21:58 - r - INFO: - Episode: 1901/2000, Reward: 40.796, Step: 300
2023-04-15 00:22:00 - r - INFO: - Episode: 1902/2000, Reward: -99.232, Step: 53
2023-04-15 00:22:04 - r - INFO: - Episode: 1903/2000, Reward: -79.466, Step: 170
2023-04-15 00:22:07 - r - INFO: - Episode: 1904/2000, Reward: -140.518, Step: 150
2023-04-15 00:22:14 - r - INFO: - Episode: 1905/2000, Reward: 35.585, Step: 300
2023-04-15 00:22:16 - r - INFO: - Episode: 1906/2000, Reward: -95.462, Step: 68
2023-04-15 00:22:22 - r - INFO: - Episode: 1907/2000, Reward: -113.558, Step: 214
2023-04-15 00:22:26 - r - INFO: - Episode: 1908/2000, Reward: -59.705, Step: 200
2023-04-15 00:22:28 - r - INFO: - Episode: 1909/2000, Reward: -99.061, Step: 73
2023-04-15 00:22:31 - r - INFO: - Episode: 1910/2000, Reward: -85.955, Step: 102
2023-04-15 00:22:32 - r - INFO: - Episode: 1911/2000, Reward: -103.713, Step: 82
2023-04-15 00:22:40 - r - INFO: - Episode: 1912/2000, Reward: -32.004, Step: 300
2023-04-15 00:22:43 - r - INFO: - Episode: 1913/2000, Reward: -92.880, Step: 135
2023-04-15 00:22:48 - r - INFO: - Episode: 1914/2000, Reward: -81.249, Step: 191
2023-04-15 00:22:49 - r - INFO: - Episode: 1915/2000, Reward: -117.298, Step: 72
2023-04-15 00:22:56 - r - INFO: - Episode: 1916/2000, Reward: 22.757, Step: 300
2023-04-15 00:23:04 - r - INFO: - Episode: 1917/2000, Reward: -24.917, Step: 300
2023-04-15 00:23:06 - r - INFO: - Episode: 1918/2000, Reward: -91.492, Step: 113
2023-04-15 00:23:09 - r - INFO: - Episode: 1919/2000, Reward: -96.764, Step: 105
2023-04-15 00:23:16 - r - INFO: - Episode: 1920/2000, Reward: -66.921, Step: 291
2023-04-15 00:23:24 - r - INFO: - Episode: 1921/2000, Reward: -97.792, Step: 112
2023-04-15 00:23:25 - r - INFO: - Episode: 1922/2000, Reward: -104.801, Step: 77
2023-04-15 00:23:28 - r - INFO: - Episode: 1923/2000, Reward: -106.061, Step: 129
2023-04-15 00:23:32 - r - INFO: - Episode: 1924/2000, Reward: -125.207, Step: 145
2023-04-15 00:23:33 - r - INFO: - Episode: 1925/2000, Reward: -104.846, Step: 60
2023-04-15 00:23:34 - r - INFO: - Episode: 1926/2000, Reward: -103.344, Step: 51
2023-04-15 00:23:35 - r - INFO: - Episode: 1927/2000, Reward: -106.077, Step: 39
2023-04-15 00:23:37 - r - INFO: - Episode: 1928/2000, Reward: -107.637, Step: 56
2023-04-15 00:23:38 - r - INFO: - Episode: 1929/2000, Reward: -105.056, Step: 62
2023-04-15 00:23:40 - r - INFO: - Episode: 1930/2000, Reward: -100.809, Step: 67
2023-04-15 00:23:43 - r - INFO: - Episode: 1931/2000, Reward: -91.044, Step: 96
2023-04-15 00:23:44 - r - INFO: - Episode: 1932/2000, Reward: -103.815, Step: 61
2023-04-15 00:23:46 - r - INFO: - Episode: 1933/2000, Reward: -106.313, Step: 67
2023-04-15 00:23:49 - r - INFO: - Episode: 1934/2000, Reward: -111.342, Step: 117
2023-04-15 00:23:57 - r - INFO: - Episode: 1935/2000, Reward: 2.419, Step: 300
2023-04-15 00:24:01 - r - INFO: - Episode: 1936/2000, Reward: -133.669, Step: 196
2023-04-15 00:24:03 - r - INFO: - Episode: 1937/2000, Reward: -115.942, Step: 93
2023-04-15 00:24:09 - r - INFO: - Episode: 1938/2000, Reward: -90.170, Step: 247
2023-04-15 00:24:12 - r - INFO: - Episode: 1939/2000, Reward: -128.075, Step: 105
2023-04-15 00:24:13 - r - INFO: - Episode: 1940/2000, Reward: -118.033, Step: 62
2023-04-15 00:24:22 - r - INFO: - Episode: 1941/2000, Reward: -113.835, Step: 256
2023-04-15 00:24:24 - r - INFO: - Episode: 1942/2000, Reward: -127.133, Step: 99
2023-04-15 00:24:28 - r - INFO: - Episode: 1943/2000, Reward: -133.533, Step: 157
2023-04-15 00:24:31 - r - INFO: - Episode: 1944/2000, Reward: -128.072, Step: 130
2023-04-15 00:24:38 - r - INFO: - Episode: 1945/2000, Reward: -16.534, Step: 300
2023-04-15 00:24:42 - r - INFO: - Episode: 1946/2000, Reward: -124.647, Step: 185
2023-04-15 00:24:44 - r - INFO: - Episode: 1947/2000, Reward: -125.097, Step: 75
2023-04-15 00:24:47 - r - INFO: - Episode: 1948/2000, Reward: -126.182, Step: 100
2023-04-15 00:24:53 - r - INFO: - Episode: 1949/2000, Reward: -146.611, Step: 248
2023-04-15 00:24:57 - r - INFO: - Episode: 1950/2000, Reward: -136.372, Step: 165
2023-04-15 00:25:02 - r - INFO: - Episode: 1951/2000, Reward: -142.721, Step: 201
2023-04-15 00:25:09 - r - INFO: - Episode: 1952/2000, Reward: -19.246, Step: 300
2023-04-15 00:25:15 - r - INFO: - Episode: 1953/2000, Reward: -145.115, Step: 244
2023-04-15 00:25:18 - r - INFO: - Episode: 1954/2000, Reward: -136.893, Step: 143
2023-04-15 00:25:25 - r - INFO: - Episode: 1955/2000, Reward: -17.870, Step: 300
2023-04-15 00:25:29 - r - INFO: - Episode: 1956/2000, Reward: -133.889, Step: 167
2023-04-15 00:25:31 - r - INFO: - Episode: 1957/2000, Reward: -119.605, Step: 68
2023-04-15 00:25:35 - r - INFO: - Episode: 1958/2000, Reward: -137.157, Step: 149
2023-04-15 00:25:42 - r - INFO: - Episode: 1959/2000, Reward: 5.694, Step: 300
2023-04-15 00:25:49 - r - INFO: - Episode: 1960/2000, Reward: -13.490, Step: 300
2023-04-15 00:26:00 - r - INFO: - Episode: 1961/2000, Reward: 20.111, Step: 300
2023-04-15 00:26:04 - r - INFO: - Episode: 1962/2000, Reward: -100.362, Step: 158
2023-04-15 00:26:11 - r - INFO: - Episode: 1963/2000, Reward: 21.665, Step: 300
2023-04-15 00:26:18 - r - INFO: - Episode: 1964/2000, Reward: -83.637, Step: 274
2023-04-15 00:26:24 - r - INFO: - Episode: 1965/2000, Reward: -78.260, Step: 222
2023-04-15 00:26:29 - r - INFO: - Episode: 1966/2000, Reward: -94.409, Step: 215
2023-04-15 00:26:32 - r - INFO: - Episode: 1967/2000, Reward: -97.257, Step: 112
2023-04-15 00:26:33 - r - INFO: - Episode: 1968/2000, Reward: -104.430, Step: 74
2023-04-15 00:26:37 - r - INFO: - Episode: 1969/2000, Reward: -101.835, Step: 169
2023-04-15 00:26:40 - r - INFO: - Episode: 1970/2000, Reward: -83.899, Step: 138
2023-04-15 00:26:43 - r - INFO: - Episode: 1971/2000, Reward: -90.541, Step: 102
2023-04-15 00:26:49 - r - INFO: - Episode: 1972/2000, Reward: -95.098, Step: 249
2023-04-15 00:26:52 - r - INFO: - Episode: 1973/2000, Reward: -76.394, Step: 141
2023-04-15 00:26:59 - r - INFO: - Episode: 1974/2000, Reward: -10.388, Step: 300
2023-04-15 00:27:03 - r - INFO: - Episode: 1975/2000, Reward: -98.810, Step: 152
2023-04-15 00:27:10 - r - INFO: - Episode: 1976/2000, Reward: -23.613, Step: 300
2023-04-15 00:27:17 - r - INFO: - Episode: 1977/2000, Reward: -12.328, Step: 300
2023-04-15 00:27:25 - r - INFO: - Episode: 1978/2000, Reward: -16.276, Step: 300
2023-04-15 00:27:32 - r - INFO: - Episode: 1979/2000, Reward: 23.668, Step: 300
2023-04-15 00:27:39 - r - INFO: - Episode: 1980/2000, Reward: -14.854, Step: 300
2023-04-15 00:27:45 - r - INFO: - Episode: 1981/2000, Reward: -99.773, Step: 69
2023-04-15 00:27:53 - r - INFO: - Episode: 1982/2000, Reward: -14.126, Step: 300
2023-04-15 00:27:55 - r - INFO: - Episode: 1983/2000, Reward: -106.883, Step: 100
2023-04-15 00:28:01 - r - INFO: - Episode: 1984/2000, Reward: -50.502, Step: 264
2023-04-15 00:28:08 - r - INFO: - Episode: 1985/2000, Reward: 18.040, Step: 300
2023-04-15 00:28:14 - r - INFO: - Episode: 1986/2000, Reward: -89.386, Step: 213
2023-04-15 00:28:22 - r - INFO: - Episode: 1987/2000, Reward: 34.395, Step: 300
2023-04-15 00:28:23 - r - INFO: - Episode: 1988/2000, Reward: -104.402, Step: 70
2023-04-15 00:28:27 - r - INFO: - Episode: 1989/2000, Reward: -88.273, Step: 136
2023-04-15 00:28:30 - r - INFO: - Episode: 1990/2000, Reward: -76.312, Step: 137
2023-04-15 00:28:35 - r - INFO: - Episode: 1991/2000, Reward: -60.010, Step: 228
2023-04-15 00:28:40 - r - INFO: - Episode: 1992/2000, Reward: -86.316, Step: 220
2023-04-15 00:28:43 - r - INFO: - Episode: 1993/2000, Reward: -103.353, Step: 123
2023-04-15 00:28:51 - r - INFO: - Episode: 1994/2000, Reward: 53.291, Step: 300
2023-04-15 00:28:54 - r - INFO: - Episode: 1995/2000, Reward: -107.525, Step: 112
2023-04-15 00:28:56 - r - INFO: - Episode: 1996/2000, Reward: -96.918, Step: 88
2023-04-15 00:28:59 - r - INFO: - Episode: 1997/2000, Reward: -132.547, Step: 151
2023-04-15 00:29:01 - r - INFO: - Episode: 1998/2000, Reward: -102.451, Step: 79
2023-04-15 00:29:08 - r - INFO: - Episode: 1999/2000, Reward: -70.587, Step: 255
2023-04-15 00:29:14 - r - INFO: - Episode: 2000/2000, Reward: -122.970, Step: 286
2023-04-15 00:29:18 - r - INFO: - Finish training!