| 2023-04-17 14:43:16 - r - INFO: - Hyperparameters: | |
| 2023-04-17 14:43:16 - r - INFO: - ================================================================================ | |
| 2023-04-17 14:43:16 - r - INFO: - Name Value Type | |
| 2023-04-17 14:43:16 - r - INFO: - env_name gym <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - new_step_api 1 <class 'bool'> | |
| 2023-04-17 14:43:16 - r - INFO: - wrapper None <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - render 0 <class 'bool'> | |
| 2023-04-17 14:43:16 - r - INFO: - render_mode None <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - algo_name BCQ <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - mode test <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - mp_backend mp <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - seed 0 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - device cpu <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - train_eps 1000 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - test_eps 200 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - eval_eps 10 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - eval_per_episode 5 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - max_steps 200 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - load_checkpoint 1 <class 'bool'> | |
| 2023-04-17 14:43:16 - r - INFO: - load_path Train_gym_BCQ_20230417-141811 <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - show_fig 0 <class 'bool'> | |
| 2023-04-17 14:43:16 - r - INFO: - save_fig 1 <class 'bool'> | |
| 2023-04-17 14:43:16 - r - INFO: - critic_hidden_dims [400, 300] <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - actor_hidden_dims [400, 300] <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - vae_hidden_dims [750, 750] <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - critic_lr 0.001 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - actor_lr 0.001 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - vae_lr 0.001 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - batch_size 128 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - gamma 0.99 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - tau 0.005 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - lmbda 0.75 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - phi 0.05 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - iters_per_ep 10 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - buffer_size 100000 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - start_learn_buffer_size 1000.0 <class 'float'> | |
| 2023-04-17 14:43:16 - r - INFO: - collect_explore_data 1 <class 'bool'> | |
| 2023-04-17 14:43:16 - r - INFO: - behavior_agent_name DDPG <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - behavior_agent_parameters_path /behave_param.yaml <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - behavior_policy_path /behaviour_models <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - collect_eps 500 <class 'int'> | |
| 2023-04-17 14:43:16 - r - INFO: - id HalfCheetah-v3 <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - task_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Test_gym_BCQ_20230417-144316 <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - res_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Test_gym_BCQ_20230417-144316/results <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - log_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Test_gym_BCQ_20230417-144316/logs <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - traj_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Test_gym_BCQ_20230417-144316/traj <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - video_dir /home/chaoqun/桌面/gitcode/joyrl-offline/tasks/Test_gym_BCQ_20230417-144316/videos <class 'str'> | |
| 2023-04-17 14:43:16 - r - INFO: - ================================================================================ | |
| 2023-04-17 14:43:17 - r - INFO: - action_bound: 1.0 | |
| 2023-04-17 14:43:17 - r - INFO: - n_states: 17, n_actions: 6 | |
| 2023-04-17 14:43:17 - r - INFO: - Start testing! | |
| 2023-04-17 14:43:17 - r - INFO: - Env: gym, Algorithm: BCQ, Device: cpu | |
| 2023-04-17 14:43:17 - r - INFO: - Episode: 1/200, Reward: 1308.262, Step: 200 | |
| 2023-04-17 14:43:17 - r - INFO: - Episode: 2/200, Reward: 1270.460, Step: 200 | |
| 2023-04-17 14:43:17 - r - INFO: - Episode: 3/200, Reward: 1232.738, Step: 200 | |
| 2023-04-17 14:43:18 - r - INFO: - Episode: 4/200, Reward: 1301.504, Step: 200 | |
| 2023-04-17 14:43:18 - r - INFO: - Episode: 5/200, Reward: 1377.433, Step: 200 | |
| 2023-04-17 14:43:18 - r - INFO: - Episode: 6/200, Reward: 1360.484, Step: 200 | |
| 2023-04-17 14:43:18 - r - INFO: - Episode: 7/200, Reward: 1209.330, Step: 200 | |
| 2023-04-17 14:43:19 - r - INFO: - Episode: 8/200, Reward: 1366.542, Step: 200 | |
| 2023-04-17 14:43:19 - r - INFO: - Episode: 9/200, Reward: 1332.486, Step: 200 | |
| 2023-04-17 14:43:19 - r - INFO: - Episode: 10/200, Reward: 1190.748, Step: 200 | |
| 2023-04-17 14:43:19 - r - INFO: - Episode: 11/200, Reward: 1329.531, Step: 200 | |
| 2023-04-17 14:43:20 - r - INFO: - Episode: 12/200, Reward: 554.371, Step: 200 | |
| 2023-04-17 14:43:20 - r - INFO: - Episode: 13/200, Reward: 1328.543, Step: 200 | |
| 2023-04-17 14:43:20 - r - INFO: - Episode: 14/200, Reward: 1327.361, Step: 200 | |
| 2023-04-17 14:43:21 - r - INFO: - Episode: 15/200, Reward: 1232.017, Step: 200 | |
| 2023-04-17 14:43:21 - r - INFO: - Episode: 16/200, Reward: 1392.045, Step: 200 | |
| 2023-04-17 14:43:21 - r - INFO: - Episode: 17/200, Reward: 1354.818, Step: 200 | |
| 2023-04-17 14:43:22 - r - INFO: - Episode: 18/200, Reward: 1305.356, Step: 200 | |
| 2023-04-17 14:43:22 - r - INFO: - Episode: 19/200, Reward: 1308.354, Step: 200 | |
| 2023-04-17 14:43:22 - r - INFO: - Episode: 20/200, Reward: 1328.289, Step: 200 | |
| 2023-04-17 14:43:22 - r - INFO: - Episode: 21/200, Reward: 1213.166, Step: 200 | |
| 2023-04-17 14:43:23 - r - INFO: - Episode: 22/200, Reward: 1335.024, Step: 200 | |
| 2023-04-17 14:43:23 - r - INFO: - Episode: 23/200, Reward: 1157.548, Step: 200 | |
| 2023-04-17 14:43:23 - r - INFO: - Episode: 24/200, Reward: 1258.234, Step: 200 | |
| 2023-04-17 14:43:23 - r - INFO: - Episode: 25/200, Reward: 1277.436, Step: 200 | |
| 2023-04-17 14:43:24 - r - INFO: - Episode: 26/200, Reward: 1267.203, Step: 200 | |
| 2023-04-17 14:43:24 - r - INFO: - Episode: 27/200, Reward: 1255.470, Step: 200 | |
| 2023-04-17 14:43:24 - r - INFO: - Episode: 28/200, Reward: 1226.970, Step: 200 | |
| 2023-04-17 14:43:25 - r - INFO: - Episode: 29/200, Reward: 1248.535, Step: 200 | |
| 2023-04-17 14:43:25 - r - INFO: - Episode: 30/200, Reward: 1320.410, Step: 200 | |
| 2023-04-17 14:43:25 - r - INFO: - Episode: 31/200, Reward: 1170.146, Step: 200 | |
| 2023-04-17 14:43:25 - r - INFO: - Episode: 32/200, Reward: 1228.375, Step: 200 | |
| 2023-04-17 14:43:26 - r - INFO: - Episode: 33/200, Reward: 1299.463, Step: 200 | |
| 2023-04-17 14:43:26 - r - INFO: - Episode: 34/200, Reward: 1309.056, Step: 200 | |
| 2023-04-17 14:43:26 - r - INFO: - Episode: 35/200, Reward: 1278.642, Step: 200 | |
| 2023-04-17 14:43:27 - r - INFO: - Episode: 36/200, Reward: 1203.290, Step: 200 | |
| 2023-04-17 14:43:27 - r - INFO: - Episode: 37/200, Reward: 1228.405, Step: 200 | |
| 2023-04-17 14:43:27 - r - INFO: - Episode: 38/200, Reward: 1319.337, Step: 200 | |
| 2023-04-17 14:43:27 - r - INFO: - Episode: 39/200, Reward: 1204.985, Step: 200 | |
| 2023-04-17 14:43:28 - r - INFO: - Episode: 40/200, Reward: 1317.443, Step: 200 | |
| 2023-04-17 14:43:28 - r - INFO: - Episode: 41/200, Reward: 1370.977, Step: 200 | |
| 2023-04-17 14:43:28 - r - INFO: - Episode: 42/200, Reward: 1275.394, Step: 200 | |
| 2023-04-17 14:43:29 - r - INFO: - Episode: 43/200, Reward: 1159.293, Step: 200 | |
| 2023-04-17 14:43:29 - r - INFO: - Episode: 44/200, Reward: 1295.355, Step: 200 | |
| 2023-04-17 14:43:29 - r - INFO: - Episode: 45/200, Reward: 1321.710, Step: 200 | |
| 2023-04-17 14:43:30 - r - INFO: - Episode: 46/200, Reward: 1315.284, Step: 200 | |
| 2023-04-17 14:43:30 - r - INFO: - Episode: 47/200, Reward: 1255.528, Step: 200 | |
| 2023-04-17 14:43:30 - r - INFO: - Episode: 48/200, Reward: 1347.399, Step: 200 | |
| 2023-04-17 14:43:30 - r - INFO: - Episode: 49/200, Reward: 1372.131, Step: 200 | |
| 2023-04-17 14:43:31 - r - INFO: - Episode: 50/200, Reward: 1258.952, Step: 200 | |
| 2023-04-17 14:43:31 - r - INFO: - Episode: 51/200, Reward: 1268.580, Step: 200 | |
| 2023-04-17 14:43:31 - r - INFO: - Episode: 52/200, Reward: 1248.082, Step: 200 | |
| 2023-04-17 14:43:31 - r - INFO: - Episode: 53/200, Reward: 1146.066, Step: 200 | |
| 2023-04-17 14:43:32 - r - INFO: - Episode: 54/200, Reward: 1319.450, Step: 200 | |
| 2023-04-17 14:43:32 - r - INFO: - Episode: 55/200, Reward: 1267.772, Step: 200 | |
| 2023-04-17 14:43:32 - r - INFO: - Episode: 56/200, Reward: 1323.475, Step: 200 | |
| 2023-04-17 14:43:32 - r - INFO: - Episode: 57/200, Reward: 1299.357, Step: 200 | |
| 2023-04-17 14:43:33 - r - INFO: - Episode: 58/200, Reward: 1327.757, Step: 200 | |
| 2023-04-17 14:43:33 - r - INFO: - Episode: 59/200, Reward: 1336.869, Step: 200 | |
| 2023-04-17 14:43:33 - r - INFO: - Episode: 60/200, Reward: 1402.798, Step: 200 | |
| 2023-04-17 14:43:33 - r - INFO: - Episode: 61/200, Reward: 1383.733, Step: 200 | |
| 2023-04-17 14:43:34 - r - INFO: - Episode: 62/200, Reward: 1339.146, Step: 200 | |
| 2023-04-17 14:43:34 - r - INFO: - Episode: 63/200, Reward: 1333.416, Step: 200 | |
| 2023-04-17 14:43:34 - r - INFO: - Episode: 64/200, Reward: 1263.389, Step: 200 | |
| 2023-04-17 14:43:34 - r - INFO: - Episode: 65/200, Reward: 1166.727, Step: 200 | |
| 2023-04-17 14:43:35 - r - INFO: - Episode: 66/200, Reward: 1349.627, Step: 200 | |
| 2023-04-17 14:43:35 - r - INFO: - Episode: 67/200, Reward: 1347.438, Step: 200 | |
| 2023-04-17 14:43:35 - r - INFO: - Episode: 68/200, Reward: 1326.951, Step: 200 | |
| 2023-04-17 14:43:36 - r - INFO: - Episode: 69/200, Reward: 1255.685, Step: 200 | |
| 2023-04-17 14:43:36 - r - INFO: - Episode: 70/200, Reward: 1353.316, Step: 200 | |
| 2023-04-17 14:43:36 - r - INFO: - Episode: 71/200, Reward: 1312.619, Step: 200 | |
| 2023-04-17 14:43:36 - r - INFO: - Episode: 72/200, Reward: 1235.518, Step: 200 | |
| 2023-04-17 14:43:37 - r - INFO: - Episode: 73/200, Reward: 1289.647, Step: 200 | |
| 2023-04-17 14:43:37 - r - INFO: - Episode: 74/200, Reward: 1113.164, Step: 200 | |
| 2023-04-17 14:43:37 - r - INFO: - Episode: 75/200, Reward: 1275.012, Step: 200 | |
| 2023-04-17 14:43:38 - r - INFO: - Episode: 76/200, Reward: 1281.044, Step: 200 | |
| 2023-04-17 14:43:38 - r - INFO: - Episode: 77/200, Reward: 1294.306, Step: 200 | |
| 2023-04-17 14:43:38 - r - INFO: - Episode: 78/200, Reward: 1248.278, Step: 200 | |
| 2023-04-17 14:43:38 - r - INFO: - Episode: 79/200, Reward: 1294.375, Step: 200 | |
| 2023-04-17 14:43:39 - r - INFO: - Episode: 80/200, Reward: 1383.276, Step: 200 | |
| 2023-04-17 14:43:39 - r - INFO: - Episode: 81/200, Reward: 1331.390, Step: 200 | |
| 2023-04-17 14:43:39 - r - INFO: - Episode: 82/200, Reward: 1417.109, Step: 200 | |
| 2023-04-17 14:43:40 - r - INFO: - Episode: 83/200, Reward: 1411.741, Step: 200 | |
| 2023-04-17 14:43:40 - r - INFO: - Episode: 84/200, Reward: 1349.740, Step: 200 | |
| 2023-04-17 14:43:40 - r - INFO: - Episode: 85/200, Reward: 1216.375, Step: 200 | |
| 2023-04-17 14:43:41 - r - INFO: - Episode: 86/200, Reward: 1332.206, Step: 200 | |
| 2023-04-17 14:43:41 - r - INFO: - Episode: 87/200, Reward: 1268.855, Step: 200 | |
| 2023-04-17 14:43:41 - r - INFO: - Episode: 88/200, Reward: 1289.923, Step: 200 | |
| 2023-04-17 14:43:41 - r - INFO: - Episode: 89/200, Reward: 1305.528, Step: 200 | |
| 2023-04-17 14:43:42 - r - INFO: - Episode: 90/200, Reward: 1364.474, Step: 200 | |
| 2023-04-17 14:43:42 - r - INFO: - Episode: 91/200, Reward: 1337.275, Step: 200 | |
| 2023-04-17 14:43:42 - r - INFO: - Episode: 92/200, Reward: 1325.012, Step: 200 | |
| 2023-04-17 14:43:43 - r - INFO: - Episode: 93/200, Reward: 1276.419, Step: 200 | |
| 2023-04-17 14:43:43 - r - INFO: - Episode: 94/200, Reward: 1223.767, Step: 200 | |
| 2023-04-17 14:43:43 - r - INFO: - Episode: 95/200, Reward: 1219.303, Step: 200 | |
| 2023-04-17 14:43:43 - r - INFO: - Episode: 96/200, Reward: 1313.126, Step: 200 | |
| 2023-04-17 14:43:44 - r - INFO: - Episode: 97/200, Reward: 1266.540, Step: 200 | |
| 2023-04-17 14:43:44 - r - INFO: - Episode: 98/200, Reward: 1313.752, Step: 200 | |
| 2023-04-17 14:43:44 - r - INFO: - Episode: 99/200, Reward: 1322.603, Step: 200 | |
| 2023-04-17 14:43:45 - r - INFO: - Episode: 100/200, Reward: 1327.168, Step: 200 | |
| 2023-04-17 14:43:45 - r - INFO: - Episode: 101/200, Reward: 1306.251, Step: 200 | |
| 2023-04-17 14:43:45 - r - INFO: - Episode: 102/200, Reward: 1311.810, Step: 200 | |
| 2023-04-17 14:43:46 - r - INFO: - Episode: 103/200, Reward: 1343.756, Step: 200 | |
| 2023-04-17 14:43:46 - r - INFO: - Episode: 104/200, Reward: 1318.610, Step: 200 | |
| 2023-04-17 14:43:46 - r - INFO: - Episode: 105/200, Reward: 1343.098, Step: 200 | |
| 2023-04-17 14:43:46 - r - INFO: - Episode: 106/200, Reward: 1314.142, Step: 200 | |
| 2023-04-17 14:43:47 - r - INFO: - Episode: 107/200, Reward: 1300.201, Step: 200 | |
| 2023-04-17 14:43:47 - r - INFO: - Episode: 108/200, Reward: 1368.704, Step: 200 | |
| 2023-04-17 14:43:47 - r - INFO: - Episode: 109/200, Reward: 1338.619, Step: 200 | |
| 2023-04-17 14:43:48 - r - INFO: - Episode: 110/200, Reward: 1347.307, Step: 200 | |
| 2023-04-17 14:43:48 - r - INFO: - Episode: 111/200, Reward: 1301.271, Step: 200 | |
| 2023-04-17 14:43:48 - r - INFO: - Episode: 112/200, Reward: 1343.502, Step: 200 | |
| 2023-04-17 14:43:49 - r - INFO: - Episode: 113/200, Reward: 1296.342, Step: 200 | |
| 2023-04-17 14:43:49 - r - INFO: - Episode: 114/200, Reward: 1145.894, Step: 200 | |
| 2023-04-17 14:43:49 - r - INFO: - Episode: 115/200, Reward: 1326.472, Step: 200 | |
| 2023-04-17 14:43:50 - r - INFO: - Episode: 116/200, Reward: 1310.095, Step: 200 | |
| 2023-04-17 14:43:50 - r - INFO: - Episode: 117/200, Reward: 1306.200, Step: 200 | |
| 2023-04-17 14:43:50 - r - INFO: - Episode: 118/200, Reward: 1269.625, Step: 200 | |
| 2023-04-17 14:43:51 - r - INFO: - Episode: 119/200, Reward: 1330.256, Step: 200 | |
| 2023-04-17 14:43:51 - r - INFO: - Episode: 120/200, Reward: 1176.782, Step: 200 | |
| 2023-04-17 14:43:51 - r - INFO: - Episode: 121/200, Reward: 1228.143, Step: 200 | |
| 2023-04-17 14:43:52 - r - INFO: - Episode: 122/200, Reward: 1292.745, Step: 200 | |
| 2023-04-17 14:43:52 - r - INFO: - Episode: 123/200, Reward: 1261.806, Step: 200 | |
| 2023-04-17 14:43:52 - r - INFO: - Episode: 124/200, Reward: 1148.581, Step: 200 | |
| 2023-04-17 14:43:52 - r - INFO: - Episode: 125/200, Reward: 1376.888, Step: 200 | |
| 2023-04-17 14:43:53 - r - INFO: - Episode: 126/200, Reward: 1270.227, Step: 200 | |
| 2023-04-17 14:43:53 - r - INFO: - Episode: 127/200, Reward: 1297.554, Step: 200 | |
| 2023-04-17 14:43:53 - r - INFO: - Episode: 128/200, Reward: 119.449, Step: 200 | |
| 2023-04-17 14:43:54 - r - INFO: - Episode: 129/200, Reward: 1283.901, Step: 200 | |
| 2023-04-17 14:43:54 - r - INFO: - Episode: 130/200, Reward: 1320.992, Step: 200 | |
| 2023-04-17 14:43:54 - r - INFO: - Episode: 131/200, Reward: 1242.699, Step: 200 | |
| 2023-04-17 14:43:54 - r - INFO: - Episode: 132/200, Reward: 1263.889, Step: 200 | |
| 2023-04-17 14:43:55 - r - INFO: - Episode: 133/200, Reward: 1265.926, Step: 200 | |
| 2023-04-17 14:43:55 - r - INFO: - Episode: 134/200, Reward: 1312.005, Step: 200 | |
| 2023-04-17 14:43:55 - r - INFO: - Episode: 135/200, Reward: 1283.035, Step: 200 | |
| 2023-04-17 14:43:56 - r - INFO: - Episode: 136/200, Reward: 1298.766, Step: 200 | |
| 2023-04-17 14:43:56 - r - INFO: - Episode: 137/200, Reward: 1229.121, Step: 200 | |
| 2023-04-17 14:43:56 - r - INFO: - Episode: 138/200, Reward: 1333.515, Step: 200 | |
| 2023-04-17 14:43:57 - r - INFO: - Episode: 139/200, Reward: 1250.741, Step: 200 | |
| 2023-04-17 14:43:57 - r - INFO: - Episode: 140/200, Reward: 1344.817, Step: 200 | |
| 2023-04-17 14:43:57 - r - INFO: - Episode: 141/200, Reward: 1194.106, Step: 200 | |
| 2023-04-17 14:43:58 - r - INFO: - Episode: 142/200, Reward: 1306.963, Step: 200 | |
| 2023-04-17 14:43:58 - r - INFO: - Episode: 143/200, Reward: 1254.498, Step: 200 | |
| 2023-04-17 14:43:58 - r - INFO: - Episode: 144/200, Reward: 1348.872, Step: 200 | |
| 2023-04-17 14:43:58 - r - INFO: - Episode: 145/200, Reward: 1267.701, Step: 200 | |
| 2023-04-17 14:43:59 - r - INFO: - Episode: 146/200, Reward: 1314.007, Step: 200 | |
| 2023-04-17 14:43:59 - r - INFO: - Episode: 147/200, Reward: 1282.027, Step: 200 | |
| 2023-04-17 14:43:59 - r - INFO: - Episode: 148/200, Reward: 1351.543, Step: 200 | |
| 2023-04-17 14:43:59 - r - INFO: - Episode: 149/200, Reward: 1338.997, Step: 200 | |
| 2023-04-17 14:44:00 - r - INFO: - Episode: 150/200, Reward: 1279.964, Step: 200 | |
| 2023-04-17 14:44:00 - r - INFO: - Episode: 151/200, Reward: 1196.204, Step: 200 | |
| 2023-04-17 14:44:00 - r - INFO: - Episode: 152/200, Reward: 1237.979, Step: 200 | |
| 2023-04-17 14:44:00 - r - INFO: - Episode: 153/200, Reward: 1299.837, Step: 200 | |
| 2023-04-17 14:44:01 - r - INFO: - Episode: 154/200, Reward: 1302.113, Step: 200 | |
| 2023-04-17 14:44:01 - r - INFO: - Episode: 155/200, Reward: 1371.231, Step: 200 | |
| 2023-04-17 14:44:01 - r - INFO: - Episode: 156/200, Reward: 1352.787, Step: 200 | |
| 2023-04-17 14:44:02 - r - INFO: - Episode: 157/200, Reward: 1328.460, Step: 200 | |
| 2023-04-17 14:44:02 - r - INFO: - Episode: 158/200, Reward: 1351.489, Step: 200 | |
| 2023-04-17 14:44:02 - r - INFO: - Episode: 159/200, Reward: 1352.125, Step: 200 | |
| 2023-04-17 14:44:03 - r - INFO: - Episode: 160/200, Reward: 1254.551, Step: 200 | |
| 2023-04-17 14:44:03 - r - INFO: - Episode: 161/200, Reward: 1350.503, Step: 200 | |
| 2023-04-17 14:44:03 - r - INFO: - Episode: 162/200, Reward: 1319.012, Step: 200 | |
| 2023-04-17 14:44:03 - r - INFO: - Episode: 163/200, Reward: 1208.436, Step: 200 | |
| 2023-04-17 14:44:04 - r - INFO: - Episode: 164/200, Reward: 1251.329, Step: 200 | |
| 2023-04-17 14:44:04 - r - INFO: - Episode: 165/200, Reward: 1239.774, Step: 200 | |
| 2023-04-17 14:44:04 - r - INFO: - Episode: 166/200, Reward: 1316.650, Step: 200 | |
| 2023-04-17 14:44:04 - r - INFO: - Episode: 167/200, Reward: 1361.254, Step: 200 | |
| 2023-04-17 14:44:05 - r - INFO: - Episode: 168/200, Reward: 1234.934, Step: 200 | |
| 2023-04-17 14:44:05 - r - INFO: - Episode: 169/200, Reward: 925.280, Step: 200 | |
| 2023-04-17 14:44:05 - r - INFO: - Episode: 170/200, Reward: 1315.849, Step: 200 | |
| 2023-04-17 14:44:05 - r - INFO: - Episode: 171/200, Reward: 1234.899, Step: 200 | |
| 2023-04-17 14:44:06 - r - INFO: - Episode: 172/200, Reward: 1222.966, Step: 200 | |
| 2023-04-17 14:44:06 - r - INFO: - Episode: 173/200, Reward: 1226.339, Step: 200 | |
| 2023-04-17 14:44:06 - r - INFO: - Episode: 174/200, Reward: 1263.257, Step: 200 | |
| 2023-04-17 14:44:06 - r - INFO: - Episode: 175/200, Reward: 1326.118, Step: 200 | |
| 2023-04-17 14:44:07 - r - INFO: - Episode: 176/200, Reward: 1337.059, Step: 200 | |
| 2023-04-17 14:44:07 - r - INFO: - Episode: 177/200, Reward: 1317.011, Step: 200 | |
| 2023-04-17 14:44:07 - r - INFO: - Episode: 178/200, Reward: 1280.764, Step: 200 | |
| 2023-04-17 14:44:08 - r - INFO: - Episode: 179/200, Reward: 1301.730, Step: 200 | |
| 2023-04-17 14:44:08 - r - INFO: - Episode: 180/200, Reward: 1261.635, Step: 200 | |
| 2023-04-17 14:44:08 - r - INFO: - Episode: 181/200, Reward: 1366.866, Step: 200 | |
| 2023-04-17 14:44:08 - r - INFO: - Episode: 182/200, Reward: 1307.725, Step: 200 | |
| 2023-04-17 14:44:09 - r - INFO: - Episode: 183/200, Reward: 1406.161, Step: 200 | |
| 2023-04-17 14:44:09 - r - INFO: - Episode: 184/200, Reward: 1276.682, Step: 200 | |
| 2023-04-17 14:44:09 - r - INFO: - Episode: 185/200, Reward: 1256.515, Step: 200 | |
| 2023-04-17 14:44:09 - r - INFO: - Episode: 186/200, Reward: 1326.052, Step: 200 | |
| 2023-04-17 14:44:10 - r - INFO: - Episode: 187/200, Reward: 985.071, Step: 200 | |
| 2023-04-17 14:44:10 - r - INFO: - Episode: 188/200, Reward: 1304.430, Step: 200 | |
| 2023-04-17 14:44:10 - r - INFO: - Episode: 189/200, Reward: 1359.663, Step: 200 | |
| 2023-04-17 14:44:11 - r - INFO: - Episode: 190/200, Reward: 1312.544, Step: 200 | |
| 2023-04-17 14:44:11 - r - INFO: - Episode: 191/200, Reward: 1142.080, Step: 200 | |
| 2023-04-17 14:44:11 - r - INFO: - Episode: 192/200, Reward: 1345.347, Step: 200 | |
| 2023-04-17 14:44:11 - r - INFO: - Episode: 193/200, Reward: 1204.062, Step: 200 | |
| 2023-04-17 14:44:12 - r - INFO: - Episode: 194/200, Reward: 1301.517, Step: 200 | |
| 2023-04-17 14:44:12 - r - INFO: - Episode: 195/200, Reward: 1236.015, Step: 200 | |
| 2023-04-17 14:44:12 - r - INFO: - Episode: 196/200, Reward: 1308.347, Step: 200 | |
| 2023-04-17 14:44:12 - r - INFO: - Episode: 197/200, Reward: 1379.318, Step: 200 | |
| 2023-04-17 14:44:13 - r - INFO: - Episode: 198/200, Reward: 1313.630, Step: 200 | |
| 2023-04-17 14:44:13 - r - INFO: - Episode: 199/200, Reward: 1373.463, Step: 200 | |
| 2023-04-17 14:44:13 - r - INFO: - Episode: 200/200, Reward: 1253.490, Step: 200 | |
| 2023-04-17 14:44:13 - r - INFO: - Finish testing! | |