2023-05-26 14:04:02 - SimpleLog - INFO: - General Configs: 2023-05-26 14:04:02 - SimpleLog - INFO: - ================================================================================ 2023-05-26 14:04:02 - SimpleLog - INFO: - Name Value Type 2023-05-26 14:04:02 - SimpleLog - INFO: - env_name gym 2023-05-26 14:04:02 - SimpleLog - INFO: - algo_name PPO 2023-05-26 14:04:02 - SimpleLog - INFO: - mode train 2023-05-26 14:04:02 - SimpleLog - INFO: - device cuda 2023-05-26 14:04:02 - SimpleLog - INFO: - seed 1 2023-05-26 14:04:02 - SimpleLog - INFO: - max_episode 2000 2023-05-26 14:04:02 - SimpleLog - INFO: - max_step 1000 2023-05-26 14:04:02 - SimpleLog - INFO: - collect_traj 0 2023-05-26 14:04:02 - SimpleLog - INFO: - mp_backend single 2023-05-26 14:04:02 - SimpleLog - INFO: - n_workers 2 2023-05-26 14:04:02 - SimpleLog - INFO: - n_learners 1 2023-05-26 14:04:02 - SimpleLog - INFO: - share_buffer 1 2023-05-26 14:04:02 - SimpleLog - INFO: - online_eval 1 2023-05-26 14:04:02 - SimpleLog - INFO: - online_eval_episode 10 2023-05-26 14:04:02 - SimpleLog - INFO: - model_save_fre 500 2023-05-26 14:04:02 - SimpleLog - INFO: - load_checkpoint 0 2023-05-26 14:04:02 - SimpleLog - INFO: - load_path Train_single_CartPole-v1_DQN_20230515-211721 2023-05-26 14:04:02 - SimpleLog - INFO: - load_model_step best 2023-05-26 14:04:02 - SimpleLog - INFO: - ================================================================================ 2023-05-26 14:04:02 - SimpleLog - INFO: - Algo Configs: 2023-05-26 14:04:02 - SimpleLog - INFO: - ================================================================================ 2023-05-26 14:04:02 - SimpleLog - INFO: - Name Value Type 2023-05-26 14:04:02 - SimpleLog - INFO: - independ_actor 1 2023-05-26 14:04:02 - SimpleLog - INFO: - share_optimizer 0 2023-05-26 14:04:02 - SimpleLog - INFO: - ppo_type clip 2023-05-26 14:04:02 - SimpleLog - INFO: - eps_clip 0.2 2023-05-26 14:04:02 - SimpleLog - INFO: - kl_target 0.1 2023-05-26 14:04:02 - SimpleLog - INFO: - kl_lambda 0.5 2023-05-26 14:04:02 - SimpleLog - INFO: - kl_beta 1.5 2023-05-26 14:04:02 - SimpleLog - INFO: - kl_alpha 2 2023-05-26 14:04:02 - SimpleLog - INFO: - continuous 1 2023-05-26 14:04:02 - SimpleLog - INFO: - gamma 0.95 2023-05-26 14:04:02 - SimpleLog - INFO: - k_epochs 8 2023-05-26 14:04:02 - SimpleLog - INFO: - lr 0.0001 2023-05-26 14:04:02 - SimpleLog - INFO: - actor_lr 0.0003 2023-05-26 14:04:02 - SimpleLog - INFO: - critic_lr 0.001 2023-05-26 14:04:02 - SimpleLog - INFO: - critic_loss_coef 0.5 2023-05-26 14:04:02 - SimpleLog - INFO: - entropy_coef 0.01 2023-05-26 14:04:02 - SimpleLog - INFO: - batch_size 256 2023-05-26 14:04:02 - SimpleLog - INFO: - sgd_batch_size 128 2023-05-26 14:04:02 - SimpleLog - INFO: - actor_hidden_dim 256 2023-05-26 14:04:02 - SimpleLog - INFO: - critic_hidden_dim 256 2023-05-26 14:04:02 - SimpleLog - INFO: - min_policy 0 2023-05-26 14:04:02 - SimpleLog - INFO: - actor_layers [{'layer_type': 'linear', 'layer_size': [256], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_size': [256], 'activation': 'relu'}] 2023-05-26 14:04:02 - SimpleLog - INFO: - critic_layers [{'layer_type': 'linear', 'layer_size': [256], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_size': [256], 'activation': 'relu'}] 2023-05-26 14:04:02 - SimpleLog - INFO: - buffer_type ONPOLICY_QUE 2023-05-26 14:04:02 - SimpleLog - INFO: - buffer_size 100000 2023-05-26 14:04:02 - SimpleLog - INFO: - epsilon_decay 500 2023-05-26 14:04:02 - SimpleLog - INFO: - epsilon_end 0.01 2023-05-26 14:04:02 - SimpleLog - INFO: - epsilon_start 0.95 2023-05-26 14:04:02 - SimpleLog - INFO: - target_update 4 2023-05-26 14:04:02 - SimpleLog - INFO: - ================================================================================ 2023-05-26 14:04:02 - SimpleLog - INFO: - Env Configs: 2023-05-26 14:04:02 - SimpleLog - INFO: - ================================================================================ 2023-05-26 14:04:02 - SimpleLog - INFO: - Name Value Type 2023-05-26 14:04:02 - SimpleLog - INFO: - id Ant-v4 2023-05-26 14:04:02 - SimpleLog - INFO: - render_mode None 2023-05-26 14:04:02 - SimpleLog - INFO: - wrapper None 2023-05-26 14:04:02 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] 2023-05-26 14:04:02 - SimpleLog - INFO: - new_step_api 1 2023-05-26 14:04:02 - SimpleLog - INFO: - ================================================================================ 2023-05-26 14:04:02 - SimpleLog - INFO: - obs_space: Box(-inf, inf, (27,), float64), n_actions: Box(-1.0, 1.0, (8,), float32) 2023-05-26 14:04:04 - SimpleLog - INFO: - Start training! 2023-05-26 14:04:06 - SimpleLog - INFO: - episode: 0, ep_reward: -19.834657487878502, ep_step: 27 2023-05-26 14:04:06 - SimpleLog - INFO: - episode: 1, ep_reward: -17.27431923885625, ep_step: 28 2023-05-26 14:04:06 - SimpleLog - INFO: - episode: 2, ep_reward: -88.34120943215203, ep_step: 53 2023-05-26 14:04:06 - SimpleLog - INFO: - episode: 3, ep_reward: -54.085571919952244, ep_step: 35 2023-05-26 14:04:06 - SimpleLog - INFO: - episode: 4, ep_reward: -106.75931375614043, ep_step: 68 2023-05-26 14:04:07 - SimpleLog - INFO: - episode: 5, ep_reward: -80.73779646971481, ep_step: 57 2023-05-26 14:04:07 - SimpleLog - INFO: - episode: 6, ep_reward: -25.09925531136118, ep_step: 27 2023-05-26 14:04:07 - SimpleLog - INFO: - episode: 7, ep_reward: -84.320573073328, ep_step: 122 2023-05-26 14:04:11 - SimpleLog - INFO: - episode: 8, ep_reward: -1228.4949600982638, ep_step: 1000 2023-05-26 14:04:11 - SimpleLog - INFO: - episode: 9, ep_reward: -118.6521922603747, ep_step: 150 2023-05-26 14:04:13 - SimpleLog - INFO: - episode: 10, ep_reward: -688.8858585500784, ep_step: 501 2023-05-26 14:04:13 - SimpleLog - INFO: - episode: 11, ep_reward: -33.20288674156899, ep_step: 21 2023-05-26 14:04:13 - SimpleLog - INFO: - episode: 12, ep_reward: -40.78347278155811, ep_step: 27 2023-05-26 14:04:13 - SimpleLog - INFO: - episode: 13, ep_reward: -229.82647798982967, ep_step: 157 2023-05-26 14:04:13 - SimpleLog - INFO: - episode: 14, ep_reward: -37.647135624180535, ep_step: 30 2023-05-26 14:04:14 - SimpleLog - INFO: - episode: 15, ep_reward: -22.437573892487784, ep_step: 24 2023-05-26 14:04:14 - SimpleLog - INFO: - episode: 16, ep_reward: -124.58903971863383, ep_step: 85 2023-05-26 14:04:14 - SimpleLog - INFO: - episode: 17, ep_reward: -75.88374933105787, ep_step: 42 2023-05-26 14:04:14 - SimpleLog - INFO: - episode: 18, ep_reward: -26.617559683194578, ep_step: 18 2023-05-26 14:04:14 - SimpleLog - INFO: - episode: 19, ep_reward: -13.909981620521759, ep_step: 13 2023-05-26 14:04:18 - SimpleLog - INFO: - episode: 20, ep_reward: -1280.7951213658398, ep_step: 1000 2023-05-26 14:04:18 - SimpleLog - INFO: - episode: 21, ep_reward: -35.371837501752324, ep_step: 49 2023-05-26 14:04:18 - SimpleLog - INFO: - episode: 22, ep_reward: -63.6565369544468, ep_step: 47 2023-05-26 14:04:18 - SimpleLog - INFO: - episode: 23, ep_reward: -4.05456019801187, ep_step: 13 2023-05-26 14:04:18 - SimpleLog - INFO: - episode: 24, ep_reward: -31.96780263810086, ep_step: 34 2023-05-26 14:04:18 - SimpleLog - INFO: - episode: 25, ep_reward: -9.181868934376045, ep_step: 25 2023-05-26 14:04:22 - SimpleLog - INFO: - episode: 26, ep_reward: -1321.340966980465, ep_step: 1000 2023-05-26 14:04:22 - SimpleLog - INFO: - episode: 27, ep_reward: -65.27055285866125, ep_step: 53 2023-05-26 14:04:22 - SimpleLog - INFO: - episode: 28, ep_reward: -65.90680573038622, ep_step: 74 2023-05-26 14:04:22 - SimpleLog - INFO: - episode: 29, ep_reward: -56.565464317072994, ep_step: 46 2023-05-26 14:04:22 - SimpleLog - INFO: - episode: 30, ep_reward: -56.8807427543045, ep_step: 30 2023-05-26 14:04:23 - SimpleLog - INFO: - episode: 31, ep_reward: -37.39866689631053, ep_step: 20 2023-05-26 14:04:23 - SimpleLog - INFO: - episode: 32, ep_reward: -41.28791113900994, ep_step: 42 2023-05-26 14:04:26 - SimpleLog - INFO: - episode: 33, ep_reward: -1350.0827104530886, ep_step: 1000 2023-05-26 14:04:26 - SimpleLog - INFO: - episode: 34, ep_reward: -59.56382555499589, ep_step: 51 2023-05-26 14:04:26 - SimpleLog - INFO: - episode: 35, ep_reward: -17.07994472579092, ep_step: 16 2023-05-26 14:04:30 - SimpleLog - INFO: - episode: 36, ep_reward: -1403.404299402506, ep_step: 1000 2023-05-26 14:04:30 - SimpleLog - INFO: - episode: 37, ep_reward: -19.73840153727198, ep_step: 20 2023-05-26 14:04:30 - SimpleLog - INFO: - episode: 38, ep_reward: -21.584813617556712, ep_step: 14 2023-05-26 14:04:30 - SimpleLog - INFO: - episode: 39, ep_reward: -37.393781676962426, ep_step: 53 2023-05-26 14:04:30 - SimpleLog - INFO: - episode: 40, ep_reward: -55.378306922448274, ep_step: 38 2023-05-26 14:04:30 - SimpleLog - INFO: - episode: 41, ep_reward: -22.27079708088825, ep_step: 18 2023-05-26 14:04:33 - SimpleLog - INFO: - episode: 42, ep_reward: -1382.9682919355066, ep_step: 1000 2023-05-26 14:04:33 - SimpleLog - INFO: - episode: 43, ep_reward: -26.4310157403141, ep_step: 13 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 44, ep_reward: -39.877275345953, ep_step: 30 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 45, ep_reward: -25.31937944392244, ep_step: 15 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 46, ep_reward: -47.10511741241008, ep_step: 39 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 47, ep_reward: -68.15780994451033, ep_step: 46 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 48, ep_reward: -24.178018428946746, ep_step: 17 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 49, ep_reward: -138.20815437836416, ep_step: 75 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 50, ep_reward: -16.336451549141607, ep_step: 13 2023-05-26 14:04:34 - SimpleLog - INFO: - episode: 51, ep_reward: -40.45580052308142, ep_step: 28 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 52, ep_reward: -60.781477092384165, ep_step: 56 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 53, ep_reward: -38.353013459188745, ep_step: 18 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 54, ep_reward: -43.95341334951536, ep_step: 32 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 55, ep_reward: -88.69109175642298, ep_step: 51 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 56, ep_reward: -72.8131545155031, ep_step: 67 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 57, ep_reward: -46.27929189748744, ep_step: 23 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 58, ep_reward: -26.61439141073238, ep_step: 22 2023-05-26 14:04:35 - SimpleLog - INFO: - episode: 59, ep_reward: -9.379803076641767, ep_step: 11 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 60, ep_reward: -16.557419100865484, ep_step: 29 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 61, ep_reward: -68.3697728130659, ep_step: 40 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 62, ep_reward: -103.61803213807316, ep_step: 50 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 63, ep_reward: -6.113615642460888, ep_step: 11 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 64, ep_reward: -35.06652640623626, ep_step: 22 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 65, ep_reward: -20.43050070782654, ep_step: 15 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 66, ep_reward: -24.415090914238778, ep_step: 30 2023-05-26 14:04:36 - SimpleLog - INFO: - episode: 67, ep_reward: -88.43025280472126, ep_step: 72 2023-05-26 14:04:37 - SimpleLog - INFO: - episode: 68, ep_reward: -21.624862280342246, ep_step: 27 2023-05-26 14:04:37 - SimpleLog - INFO: - episode: 69, ep_reward: -26.9622829139434, ep_step: 14 2023-05-26 14:04:37 - SimpleLog - INFO: - episode: 70, ep_reward: -5.832840270666464, ep_step: 25 2023-05-26 14:04:37 - SimpleLog - INFO: - episode: 71, ep_reward: -30.937034993430718, ep_step: 17 2023-05-26 14:04:37 - SimpleLog - INFO: - episode: 72, ep_reward: -15.476847848613586, ep_step: 13 2023-05-26 14:04:37 - SimpleLog - INFO: - episode: 73, ep_reward: -13.57137891280624, ep_step: 16 2023-05-26 14:04:40 - SimpleLog - INFO: - episode: 74, ep_reward: -1445.2750419615072, ep_step: 1000 2023-05-26 14:04:40 - SimpleLog - INFO: - episode: 75, ep_reward: -55.5398505045109, ep_step: 27 2023-05-26 14:04:40 - SimpleLog - INFO: - episode: 76, ep_reward: -22.358524667385595, ep_step: 33 2023-05-26 14:04:41 - SimpleLog - INFO: - episode: 77, ep_reward: -160.37868444650462, ep_step: 116 2023-05-26 14:04:41 - SimpleLog - INFO: - episode: 78, ep_reward: -56.043118790627425, ep_step: 23 2023-05-26 14:04:41 - SimpleLog - INFO: - episode: 79, ep_reward: -102.31131116338723, ep_step: 78 2023-05-26 14:04:45 - SimpleLog - INFO: - episode: 80, ep_reward: -1491.9086619954144, ep_step: 1000 2023-05-26 14:04:48 - SimpleLog - INFO: - episode: 81, ep_reward: -1511.6116161734744, ep_step: 1000 2023-05-26 14:04:48 - SimpleLog - INFO: - episode: 82, ep_reward: -26.331403665800085, ep_step: 11 2023-05-26 14:04:48 - SimpleLog - INFO: - episode: 83, ep_reward: -16.399344802694667, ep_step: 13 2023-05-26 14:04:48 - SimpleLog - INFO: - episode: 84, ep_reward: 2.3035583045117782, ep_step: 25 2023-05-26 14:04:48 - SimpleLog - INFO: - episode: 85, ep_reward: -15.46091440293506, ep_step: 13 2023-05-26 14:04:48 - SimpleLog - INFO: - episode: 86, ep_reward: -21.79582547619852, ep_step: 22 2023-05-26 14:04:48 - SimpleLog - INFO: - episode: 87, ep_reward: -51.649573864129565, ep_step: 22 2023-05-26 14:04:52 - SimpleLog - INFO: - episode: 88, ep_reward: -1417.0055842865102, ep_step: 1000 2023-05-26 14:04:52 - SimpleLog - INFO: - episode: 89, ep_reward: -68.74490238516721, ep_step: 37 2023-05-26 14:04:52 - SimpleLog - INFO: - episode: 90, ep_reward: -12.27823842079673, ep_step: 12 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 91, ep_reward: -128.80047123780605, ep_step: 89 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 92, ep_reward: -66.63221656173704, ep_step: 38 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 93, ep_reward: -74.55499341618443, ep_step: 55 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 94, ep_reward: -42.96931071297108, ep_step: 24 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 95, ep_reward: -52.40394596109042, ep_step: 24 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 96, ep_reward: -29.396062126663864, ep_step: 25 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 97, ep_reward: -9.006815518718621, ep_step: 35 2023-05-26 14:04:53 - SimpleLog - INFO: - episode: 98, ep_reward: -32.60109204916286, ep_step: 16 2023-05-26 14:04:54 - SimpleLog - INFO: - episode: 99, ep_reward: -34.83581333951125, ep_step: 23 2023-05-26 14:04:54 - SimpleLog - INFO: - episode: 100, ep_reward: -31.382453609604426, ep_step: 19 2023-05-26 14:04:54 - SimpleLog - INFO: - episode: 101, ep_reward: -22.328716748977026, ep_step: 26 2023-05-26 14:04:54 - SimpleLog - INFO: - episode: 102, ep_reward: -16.442268305474464, ep_step: 16 2023-05-26 14:04:54 - SimpleLog - INFO: - episode: 103, ep_reward: -16.52401744431793, ep_step: 14 2023-05-26 14:04:57 - SimpleLog - INFO: - episode: 104, ep_reward: -1429.8232431857937, ep_step: 1000 2023-05-26 14:04:57 - SimpleLog - INFO: - episode: 105, ep_reward: -6.982274090641003, ep_step: 11 2023-05-26 14:04:57 - SimpleLog - INFO: - episode: 106, ep_reward: -33.07453726780767, ep_step: 25 2023-05-26 14:04:57 - SimpleLog - INFO: - episode: 107, ep_reward: -46.889800332881656, ep_step: 34 2023-05-26 14:05:01 - SimpleLog - INFO: - episode: 108, ep_reward: -1508.8839259315353, ep_step: 1000 2023-05-26 14:05:01 - SimpleLog - INFO: - episode: 109, ep_reward: -49.02550569363317, ep_step: 33 2023-05-26 14:05:01 - SimpleLog - INFO: - episode: 110, ep_reward: -32.21427191365114, ep_step: 35 2023-05-26 14:05:01 - SimpleLog - INFO: - episode: 111, ep_reward: -23.32941597576326, ep_step: 14 2023-05-26 14:05:01 - SimpleLog - INFO: - episode: 112, ep_reward: -36.458339890412645, ep_step: 26 2023-05-26 14:05:01 - SimpleLog - INFO: - episode: 113, ep_reward: -46.91216957917233, ep_step: 26 2023-05-26 14:05:01 - SimpleLog - INFO: - episode: 114, ep_reward: -35.28268464366878, ep_step: 22 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 115, ep_reward: -24.620388412801393, ep_step: 18 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 116, ep_reward: -36.819904870935204, ep_step: 15 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 117, ep_reward: -10.106251769087677, ep_step: 12 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 118, ep_reward: -28.517931816733764, ep_step: 27 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 119, ep_reward: -8.691354850249244, ep_step: 14 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 120, ep_reward: -18.214947113727284, ep_step: 11 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 121, ep_reward: -21.262790632934347, ep_step: 18 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 122, ep_reward: -13.61964227747727, ep_step: 12 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 123, ep_reward: -64.03764131447718, ep_step: 56 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 124, ep_reward: -43.57202534651185, ep_step: 37 2023-05-26 14:05:02 - SimpleLog - INFO: - episode: 125, ep_reward: -38.742067673202115, ep_step: 39 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 126, ep_reward: 2.210071435359791, ep_step: 18 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 127, ep_reward: -19.6906103764232, ep_step: 12 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 128, ep_reward: -54.115684434218544, ep_step: 30 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 129, ep_reward: -43.672505946531295, ep_step: 27 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 130, ep_reward: -22.036818309472395, ep_step: 18 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 131, ep_reward: -32.568035130825216, ep_step: 25 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 132, ep_reward: -7.377753006834871, ep_step: 12 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 133, ep_reward: -58.28769024005552, ep_step: 29 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 134, ep_reward: -17.894617555701412, ep_step: 14 2023-05-26 14:05:03 - SimpleLog - INFO: - episode: 135, ep_reward: -6.041993960529217, ep_step: 14 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 136, ep_reward: -116.02996472930556, ep_step: 78 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 137, ep_reward: -22.59717542579064, ep_step: 16 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 138, ep_reward: -14.96574690938561, ep_step: 13 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 139, ep_reward: -54.79953975348864, ep_step: 34 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 140, ep_reward: -29.53122126928331, ep_step: 23 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 141, ep_reward: -30.10039516050646, ep_step: 15 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 142, ep_reward: -26.620696705281933, ep_step: 23 2023-05-26 14:05:04 - SimpleLog - INFO: - episode: 143, ep_reward: -138.16354967876063, ep_step: 110 2023-05-26 14:05:05 - SimpleLog - INFO: - episode: 144, ep_reward: -49.342856984494134, ep_step: 31 2023-05-26 14:05:05 - SimpleLog - INFO: - episode: 145, ep_reward: -53.082695245393, ep_step: 32 2023-05-26 14:05:05 - SimpleLog - INFO: - episode: 146, ep_reward: -26.75629049910419, ep_step: 30 2023-05-26 14:05:05 - SimpleLog - INFO: - episode: 147, ep_reward: -18.372089553496725, ep_step: 12 2023-05-26 14:05:05 - SimpleLog - INFO: - episode: 148, ep_reward: -75.84222574766935, ep_step: 48 2023-05-26 14:05:08 - SimpleLog - INFO: - episode: 149, ep_reward: -1491.129565476259, ep_step: 1000 2023-05-26 14:05:08 - SimpleLog - INFO: - episode: 150, ep_reward: -56.99505267846443, ep_step: 31 2023-05-26 14:05:08 - SimpleLog - INFO: - episode: 151, ep_reward: -8.507690869648592, ep_step: 34 2023-05-26 14:05:08 - SimpleLog - INFO: - episode: 152, ep_reward: -28.211242094538694, ep_step: 17 2023-05-26 14:05:09 - SimpleLog - INFO: - episode: 153, ep_reward: -26.625728402828408, ep_step: 19 2023-05-26 14:05:09 - SimpleLog - INFO: - episode: 154, ep_reward: -256.02437917389955, ep_step: 182 2023-05-26 14:05:09 - SimpleLog - INFO: - episode: 155, ep_reward: -36.01885389303983, ep_step: 24 2023-05-26 14:05:09 - SimpleLog - INFO: - episode: 156, ep_reward: -27.387363323734295, ep_step: 31 2023-05-26 14:05:09 - SimpleLog - INFO: - episode: 157, ep_reward: -57.45459108271534, ep_step: 28 2023-05-26 14:05:09 - SimpleLog - INFO: - episode: 158, ep_reward: -29.5714317173715, ep_step: 14 2023-05-26 14:05:10 - SimpleLog - INFO: - episode: 159, ep_reward: -168.10804819438374, ep_step: 103 2023-05-26 14:05:10 - SimpleLog - INFO: - episode: 160, ep_reward: -30.266026851710066, ep_step: 20 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 161, ep_reward: -256.27150124283196, ep_step: 175 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 162, ep_reward: -11.670143158893126, ep_step: 14 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 163, ep_reward: -47.66257432430029, ep_step: 42 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 164, ep_reward: -83.80508652898364, ep_step: 39 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 165, ep_reward: -51.5594827760306, ep_step: 41 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 166, ep_reward: -41.803805465521606, ep_step: 48 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 167, ep_reward: -39.04113533335681, ep_step: 22 2023-05-26 14:05:11 - SimpleLog - INFO: - episode: 168, ep_reward: -101.93355742077152, ep_step: 52 2023-05-26 14:05:12 - SimpleLog - INFO: - episode: 169, ep_reward: -24.43726591881698, ep_step: 18 2023-05-26 14:05:15 - SimpleLog - INFO: - episode: 170, ep_reward: -1432.9177987206542, ep_step: 923 2023-05-26 14:05:15 - SimpleLog - INFO: - episode: 171, ep_reward: -139.6561578354238, ep_step: 83 2023-05-26 14:05:15 - SimpleLog - INFO: - episode: 172, ep_reward: -17.41296570948908, ep_step: 16 2023-05-26 14:05:15 - SimpleLog - INFO: - episode: 173, ep_reward: -35.97109761932523, ep_step: 24 2023-05-26 14:05:15 - SimpleLog - INFO: - episode: 174, ep_reward: -9.659498714737635, ep_step: 13 2023-05-26 14:05:15 - SimpleLog - INFO: - episode: 175, ep_reward: -30.591542731469726, ep_step: 23 2023-05-26 14:05:15 - SimpleLog - INFO: - episode: 176, ep_reward: -106.79420164413594, ep_step: 96 2023-05-26 14:05:19 - SimpleLog - INFO: - episode: 177, ep_reward: -1497.643712379635, ep_step: 1000 2023-05-26 14:05:19 - SimpleLog - INFO: - episode: 178, ep_reward: -16.964448528379247, ep_step: 29 2023-05-26 14:05:19 - SimpleLog - INFO: - episode: 179, ep_reward: -81.2651539502224, ep_step: 75 2023-05-26 14:05:19 - SimpleLog - INFO: - episode: 180, ep_reward: -28.258547166026876, ep_step: 20 2023-05-26 14:05:20 - SimpleLog - INFO: - episode: 181, ep_reward: -117.66126067149972, ep_step: 95 2023-05-26 14:05:20 - SimpleLog - INFO: - episode: 182, ep_reward: -19.127096308764507, ep_step: 16 2023-05-26 14:05:20 - SimpleLog - INFO: - episode: 183, ep_reward: -16.05012263779131, ep_step: 11 2023-05-26 14:05:20 - SimpleLog - INFO: - episode: 184, ep_reward: -51.15428057048142, ep_step: 25 2023-05-26 14:05:20 - SimpleLog - INFO: - episode: 185, ep_reward: -30.64910073564494, ep_step: 22 2023-05-26 14:05:20 - SimpleLog - INFO: - episode: 186, ep_reward: -77.05086107708192, ep_step: 36 2023-05-26 14:05:20 - SimpleLog - INFO: - episode: 187, ep_reward: 8.969506686433117, ep_step: 23 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 188, ep_reward: -139.99748276438518, ep_step: 105 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 189, ep_reward: -32.18276972991011, ep_step: 16 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 190, ep_reward: -48.78563059672349, ep_step: 35 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 191, ep_reward: -40.78774155600105, ep_step: 22 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 192, ep_reward: -45.64726515663174, ep_step: 34 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 193, ep_reward: -33.88771962108463, ep_step: 29 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 194, ep_reward: -24.783612833515207, ep_step: 15 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 195, ep_reward: -117.9714911685302, ep_step: 81 2023-05-26 14:05:21 - SimpleLog - INFO: - episode: 196, ep_reward: -41.74232614409661, ep_step: 27 2023-05-26 14:05:22 - SimpleLog - INFO: - episode: 197, ep_reward: -51.76232856181954, ep_step: 25 2023-05-26 14:05:22 - SimpleLog - INFO: - episode: 198, ep_reward: -40.53269024494726, ep_step: 24 2023-05-26 14:05:22 - SimpleLog - INFO: - episode: 199, ep_reward: -121.71580733491166, ep_step: 80 2023-05-26 14:05:22 - SimpleLog - INFO: - episode: 200, ep_reward: -137.70704378400848, ep_step: 143 2023-05-26 14:05:22 - SimpleLog - INFO: - episode: 201, ep_reward: -29.92000692438944, ep_step: 18 2023-05-26 14:05:23 - SimpleLog - INFO: - episode: 202, ep_reward: -453.44852215197517, ep_step: 304 2023-05-26 14:05:24 - SimpleLog - INFO: - episode: 203, ep_reward: -149.2688143639641, ep_step: 91 2023-05-26 14:05:24 - SimpleLog - INFO: - episode: 204, ep_reward: -31.13929741689287, ep_step: 15 2023-05-26 14:05:24 - SimpleLog - INFO: - episode: 205, ep_reward: -223.58675399160956, ep_step: 130 2023-05-26 14:05:24 - SimpleLog - INFO: - episode: 206, ep_reward: -38.39523024137625, ep_step: 19 2023-05-26 14:05:24 - SimpleLog - INFO: - episode: 207, ep_reward: -37.62490886829266, ep_step: 28 2023-05-26 14:05:25 - SimpleLog - INFO: - episode: 208, ep_reward: -15.679789000835953, ep_step: 25 2023-05-26 14:05:25 - SimpleLog - INFO: - episode: 209, ep_reward: -104.45127429611374, ep_step: 90 2023-05-26 14:05:26 - SimpleLog - INFO: - episode: 210, ep_reward: -615.6850343930446, ep_step: 404 2023-05-26 14:05:26 - SimpleLog - INFO: - episode: 211, ep_reward: -19.90725185903592, ep_step: 12 2023-05-26 14:05:27 - SimpleLog - INFO: - episode: 212, ep_reward: -71.65186202431367, ep_step: 48 2023-05-26 14:05:27 - SimpleLog - INFO: - episode: 213, ep_reward: -57.6646653501218, ep_step: 33 2023-05-26 14:05:27 - SimpleLog - INFO: - episode: 214, ep_reward: -102.66272042081013, ep_step: 81 2023-05-26 14:05:27 - SimpleLog - INFO: - episode: 215, ep_reward: -15.92154261302188, ep_step: 25 2023-05-26 14:05:27 - SimpleLog - INFO: - episode: 216, ep_reward: -13.878270762385576, ep_step: 40 2023-05-26 14:05:27 - SimpleLog - INFO: - episode: 217, ep_reward: -27.63863970227814, ep_step: 25 2023-05-26 14:05:27 - SimpleLog - INFO: - episode: 218, ep_reward: -30.913585635241247, ep_step: 18 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 219, ep_reward: -1520.5289680465999, ep_step: 1000 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 220, ep_reward: -22.440590851437026, ep_step: 26 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 221, ep_reward: -12.379821158230577, ep_step: 11 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 222, ep_reward: -46.92608654248683, ep_step: 32 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 223, ep_reward: -45.738381275928, ep_step: 22 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 224, ep_reward: -137.89513971659886, ep_step: 72 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 225, ep_reward: -14.52058064774345, ep_step: 13 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 226, ep_reward: -50.95614502237221, ep_step: 25 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 227, ep_reward: -10.76872346657209, ep_step: 11 2023-05-26 14:05:31 - SimpleLog - INFO: - episode: 228, ep_reward: -66.6364948346714, ep_step: 43 2023-05-26 14:05:32 - SimpleLog - INFO: - episode: 229, ep_reward: -102.30124225448469, ep_step: 66 2023-05-26 14:05:32 - SimpleLog - INFO: - episode: 230, ep_reward: -101.82816533680298, ep_step: 50 2023-05-26 14:05:32 - SimpleLog - INFO: - episode: 231, ep_reward: -2.7859151901940113, ep_step: 28 2023-05-26 14:05:32 - SimpleLog - INFO: - episode: 232, ep_reward: -144.4848225429863, ep_step: 81 2023-05-26 14:05:32 - SimpleLog - INFO: - episode: 233, ep_reward: -21.754841217356326, ep_step: 25 2023-05-26 14:05:33 - SimpleLog - INFO: - episode: 234, ep_reward: -30.83485267809591, ep_step: 19 2023-05-26 14:05:33 - SimpleLog - INFO: - episode: 235, ep_reward: -24.3770604006461, ep_step: 22 2023-05-26 14:05:33 - SimpleLog - INFO: - episode: 236, ep_reward: -53.27492733985057, ep_step: 20 2023-05-26 14:05:33 - SimpleLog - INFO: - episode: 237, ep_reward: -22.36556332771221, ep_step: 17 2023-05-26 14:05:33 - SimpleLog - INFO: - episode: 238, ep_reward: -64.70963244317807, ep_step: 51 2023-05-26 14:05:33 - SimpleLog - INFO: - episode: 239, ep_reward: -41.348498272886154, ep_step: 31 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 240, ep_reward: -410.51714726274804, ep_step: 213 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 241, ep_reward: -11.579429994831173, ep_step: 12 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 242, ep_reward: -43.75667960571825, ep_step: 28 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 243, ep_reward: -35.25205640540884, ep_step: 27 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 244, ep_reward: -50.10406477380851, ep_step: 27 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 245, ep_reward: -36.15817329274095, ep_step: 40 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 246, ep_reward: -52.17058698087753, ep_step: 35 2023-05-26 14:05:34 - SimpleLog - INFO: - episode: 247, ep_reward: -58.299579253261186, ep_step: 58 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 248, ep_reward: -10.734709506754037, ep_step: 12 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 249, ep_reward: -121.8931147390235, ep_step: 51 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 250, ep_reward: -14.809477026754218, ep_step: 18 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 251, ep_reward: -48.75490561523465, ep_step: 35 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 252, ep_reward: -25.707232320917157, ep_step: 25 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 253, ep_reward: -66.80754879234115, ep_step: 72 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 254, ep_reward: -24.287002110607244, ep_step: 27 2023-05-26 14:05:35 - SimpleLog - INFO: - episode: 255, ep_reward: -55.31975550679142, ep_step: 46 2023-05-26 14:05:39 - SimpleLog - INFO: - episode: 256, ep_reward: -1502.0959978504218, ep_step: 1000 2023-05-26 14:05:39 - SimpleLog - INFO: - episode: 257, ep_reward: -28.215008224016096, ep_step: 16 2023-05-26 14:05:39 - SimpleLog - INFO: - episode: 258, ep_reward: -81.01061213684712, ep_step: 60 2023-05-26 14:05:39 - SimpleLog - INFO: - episode: 259, ep_reward: -29.264757282196168, ep_step: 13 2023-05-26 14:05:39 - SimpleLog - INFO: - episode: 260, ep_reward: -64.49855075464649, ep_step: 44 2023-05-26 14:05:39 - SimpleLog - INFO: - episode: 261, ep_reward: 6.167462705464146, ep_step: 33 2023-05-26 14:05:40 - SimpleLog - INFO: - episode: 262, ep_reward: -16.191298371732422, ep_step: 14 2023-05-26 14:05:40 - SimpleLog - INFO: - episode: 263, ep_reward: -52.1938719748293, ep_step: 34 2023-05-26 14:05:40 - SimpleLog - INFO: - episode: 264, ep_reward: -352.57236180104286, ep_step: 202 2023-05-26 14:05:40 - SimpleLog - INFO: - episode: 265, ep_reward: -8.87223946174019, ep_step: 15 2023-05-26 14:05:40 - SimpleLog - INFO: - episode: 266, ep_reward: -28.735858799715963, ep_step: 15 2023-05-26 14:05:40 - SimpleLog - INFO: - episode: 267, ep_reward: -14.258207154741875, ep_step: 14 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 268, ep_reward: -22.200108864798114, ep_step: 22 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 269, ep_reward: -17.731129392846864, ep_step: 12 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 270, ep_reward: -140.70578983139555, ep_step: 75 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 271, ep_reward: -82.37821410469, ep_step: 42 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 272, ep_reward: -15.198843426959803, ep_step: 13 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 273, ep_reward: -30.417748744890137, ep_step: 39 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 274, ep_reward: -29.68362196734162, ep_step: 30 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 275, ep_reward: -13.186836325739604, ep_step: 14 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 276, ep_reward: -10.967014634068384, ep_step: 17 2023-05-26 14:05:41 - SimpleLog - INFO: - episode: 277, ep_reward: -46.14724783542773, ep_step: 25 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 278, ep_reward: -33.49704985595945, ep_step: 30 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 279, ep_reward: -123.54579541611938, ep_step: 87 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 280, ep_reward: -15.325926265974084, ep_step: 19 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 281, ep_reward: -66.88757555848429, ep_step: 43 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 282, ep_reward: -35.326234253106804, ep_step: 20 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 283, ep_reward: -49.24009862515446, ep_step: 44 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 284, ep_reward: -62.962173641950606, ep_step: 25 2023-05-26 14:05:42 - SimpleLog - INFO: - episode: 285, ep_reward: -38.03726781674391, ep_step: 32 2023-05-26 14:05:43 - SimpleLog - INFO: - episode: 286, ep_reward: -33.93986202188487, ep_step: 24 2023-05-26 14:05:43 - SimpleLog - INFO: - episode: 287, ep_reward: -10.268779283309826, ep_step: 51 2023-05-26 14:05:46 - SimpleLog - INFO: - episode: 288, ep_reward: -1539.9836818269441, ep_step: 1000 2023-05-26 14:05:46 - SimpleLog - INFO: - episode: 289, ep_reward: -20.783112973595724, ep_step: 11 2023-05-26 14:05:46 - SimpleLog - INFO: - episode: 290, ep_reward: -20.726058542652694, ep_step: 15 2023-05-26 14:05:46 - SimpleLog - INFO: - episode: 291, ep_reward: -37.140659474846665, ep_step: 19 2023-05-26 14:05:46 - SimpleLog - INFO: - episode: 292, ep_reward: -89.04680417723497, ep_step: 45 2023-05-26 14:05:50 - SimpleLog - INFO: - episode: 293, ep_reward: -1661.8407839752397, ep_step: 1000 2023-05-26 14:05:50 - SimpleLog - INFO: - episode: 294, ep_reward: -40.20392860511854, ep_step: 29 2023-05-26 14:05:50 - SimpleLog - INFO: - episode: 295, ep_reward: -44.50145977354808, ep_step: 41 2023-05-26 14:05:54 - SimpleLog - INFO: - episode: 296, ep_reward: -1597.79251081209, ep_step: 1000 2023-05-26 14:05:54 - SimpleLog - INFO: - episode: 297, ep_reward: -89.73639717161409, ep_step: 58 2023-05-26 14:05:54 - SimpleLog - INFO: - episode: 298, ep_reward: -83.47783013161096, ep_step: 70 2023-05-26 14:05:54 - SimpleLog - INFO: - episode: 299, ep_reward: -19.63127555909828, ep_step: 12 2023-05-26 14:05:54 - SimpleLog - INFO: - episode: 300, ep_reward: -166.4028910635824, ep_step: 85 2023-05-26 14:05:55 - SimpleLog - INFO: - episode: 301, ep_reward: -114.95076441805519, ep_step: 61 2023-05-26 14:05:55 - SimpleLog - INFO: - episode: 302, ep_reward: -24.810414605572742, ep_step: 23 2023-05-26 14:05:55 - SimpleLog - INFO: - episode: 303, ep_reward: -40.18378499604579, ep_step: 34 2023-05-26 14:05:55 - SimpleLog - INFO: - episode: 304, ep_reward: -27.56949632628529, ep_step: 20 2023-05-26 14:05:55 - SimpleLog - INFO: - episode: 305, ep_reward: -53.62332882344767, ep_step: 23 2023-05-26 14:05:55 - SimpleLog - INFO: - episode: 306, ep_reward: -21.337642845389237, ep_step: 13 2023-05-26 14:05:56 - SimpleLog - INFO: - episode: 307, ep_reward: -196.74635572767414, ep_step: 96 2023-05-26 14:05:56 - SimpleLog - INFO: - episode: 308, ep_reward: -30.5119268579883, ep_step: 40 2023-05-26 14:05:56 - SimpleLog - INFO: - episode: 309, ep_reward: -49.75406959743017, ep_step: 28 2023-05-26 14:05:57 - SimpleLog - INFO: - episode: 310, ep_reward: -358.48007757552153, ep_step: 200 2023-05-26 14:05:57 - SimpleLog - INFO: - episode: 311, ep_reward: -153.17101563119016, ep_step: 98 2023-05-26 14:05:57 - SimpleLog - INFO: - episode: 312, ep_reward: -55.150122954331955, ep_step: 49 2023-05-26 14:05:57 - SimpleLog - INFO: - episode: 313, ep_reward: -34.19913160128854, ep_step: 22 2023-05-26 14:05:57 - SimpleLog - INFO: - episode: 314, ep_reward: -38.362625092300405, ep_step: 18 2023-05-26 14:05:58 - SimpleLog - INFO: - episode: 315, ep_reward: -112.20163435132265, ep_step: 55 2023-05-26 14:05:58 - SimpleLog - INFO: - episode: 316, ep_reward: -60.01030693423632, ep_step: 32 2023-05-26 14:05:58 - SimpleLog - INFO: - episode: 317, ep_reward: -35.233482263823994, ep_step: 19 2023-05-26 14:05:58 - SimpleLog - INFO: - episode: 318, ep_reward: -44.6220376204693, ep_step: 29 2023-05-26 14:05:58 - SimpleLog - INFO: - episode: 319, ep_reward: -109.1337223664084, ep_step: 85 2023-05-26 14:05:58 - SimpleLog - INFO: - episode: 320, ep_reward: -20.938314049126845, ep_step: 14 2023-05-26 14:05:58 - SimpleLog - INFO: - episode: 321, ep_reward: -42.336907547322355, ep_step: 19 2023-05-26 14:05:59 - SimpleLog - INFO: - episode: 322, ep_reward: -98.52710286077169, ep_step: 60 2023-05-26 14:05:59 - SimpleLog - INFO: - episode: 323, ep_reward: -66.19657041272772, ep_step: 37 2023-05-26 14:05:59 - SimpleLog - INFO: - episode: 324, ep_reward: -71.89366297541977, ep_step: 41 2023-05-26 14:05:59 - SimpleLog - INFO: - episode: 325, ep_reward: -40.57068134429517, ep_step: 40 2023-05-26 14:05:59 - SimpleLog - INFO: - episode: 326, ep_reward: -70.81586988114019, ep_step: 36 2023-05-26 14:05:59 - SimpleLog - INFO: - episode: 327, ep_reward: -43.51331036535964, ep_step: 54 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 328, ep_reward: -121.71291804465609, ep_step: 56 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 329, ep_reward: -105.9589389011247, ep_step: 65 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 330, ep_reward: -14.428112377031496, ep_step: 11 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 331, ep_reward: -22.618202500481782, ep_step: 12 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 332, ep_reward: -80.20893975902398, ep_step: 40 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 333, ep_reward: -63.30358208834374, ep_step: 46 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 334, ep_reward: -77.5275639421674, ep_step: 55 2023-05-26 14:06:00 - SimpleLog - INFO: - episode: 335, ep_reward: -47.118693464580915, ep_step: 20 2023-05-26 14:06:01 - SimpleLog - INFO: - episode: 336, ep_reward: -122.25355036698866, ep_step: 61 2023-05-26 14:06:01 - SimpleLog - INFO: - episode: 337, ep_reward: -37.15043084623501, ep_step: 34 2023-05-26 14:06:01 - SimpleLog - INFO: - episode: 338, ep_reward: -47.00476071196379, ep_step: 26 2023-05-26 14:06:01 - SimpleLog - INFO: - episode: 339, ep_reward: -23.355741568503664, ep_step: 32 2023-05-26 14:06:01 - SimpleLog - INFO: - episode: 340, ep_reward: -36.493371840648, ep_step: 17 2023-05-26 14:06:01 - SimpleLog - INFO: - episode: 341, ep_reward: -35.34917808262526, ep_step: 19 2023-05-26 14:06:01 - SimpleLog - INFO: - episode: 342, ep_reward: -17.565450881068468, ep_step: 20 2023-05-26 14:06:05 - SimpleLog - INFO: - episode: 343, ep_reward: -1583.8348476063175, ep_step: 1000 2023-05-26 14:06:05 - SimpleLog - INFO: - episode: 344, ep_reward: -39.29499413028141, ep_step: 61 2023-05-26 14:06:05 - SimpleLog - INFO: - episode: 345, ep_reward: -20.37753773830102, ep_step: 14 2023-05-26 14:06:05 - SimpleLog - INFO: - episode: 346, ep_reward: -5.841092186711181, ep_step: 17 2023-05-26 14:06:08 - SimpleLog - INFO: - episode: 347, ep_reward: -1587.057781111336, ep_step: 1000 2023-05-26 14:06:08 - SimpleLog - INFO: - episode: 348, ep_reward: -66.06916743184405, ep_step: 24 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 349, ep_reward: -364.7696794960729, ep_step: 233 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 350, ep_reward: -25.688078962950872, ep_step: 20 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 351, ep_reward: -49.90998287306939, ep_step: 48 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 352, ep_reward: -57.005263681545145, ep_step: 42 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 353, ep_reward: -57.72206315583253, ep_step: 39 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 354, ep_reward: -13.167441562245061, ep_step: 14 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 355, ep_reward: -30.899949949184837, ep_step: 15 2023-05-26 14:06:09 - SimpleLog - INFO: - episode: 356, ep_reward: -19.16253414991763, ep_step: 15 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 357, ep_reward: -22.589411611862594, ep_step: 60 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 358, ep_reward: -12.166433577317234, ep_step: 14 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 359, ep_reward: -86.48526022549113, ep_step: 79 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 360, ep_reward: -44.7371016611711, ep_step: 23 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 361, ep_reward: -29.5034531249144, ep_step: 33 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 362, ep_reward: -6.579874781613905, ep_step: 12 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 363, ep_reward: -33.54673237321715, ep_step: 26 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 364, ep_reward: -21.45952381713591, ep_step: 16 2023-05-26 14:06:10 - SimpleLog - INFO: - episode: 365, ep_reward: -37.28160853072368, ep_step: 28 2023-05-26 14:06:11 - SimpleLog - INFO: - episode: 366, ep_reward: -77.46779727681195, ep_step: 41 2023-05-26 14:06:11 - SimpleLog - INFO: - episode: 367, ep_reward: -44.67239636414761, ep_step: 38 2023-05-26 14:06:13 - SimpleLog - INFO: - episode: 368, ep_reward: -1673.6155925051546, ep_step: 1000 2023-05-26 14:06:13 - SimpleLog - INFO: - episode: 369, ep_reward: -26.95399653005468, ep_step: 16 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 370, ep_reward: -11.419535014813441, ep_step: 12 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 371, ep_reward: -20.4054664425634, ep_step: 12 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 372, ep_reward: -22.260583145706505, ep_step: 17 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 373, ep_reward: -47.411474985643956, ep_step: 50 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 374, ep_reward: -55.95799022955494, ep_step: 26 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 375, ep_reward: -17.415853752693817, ep_step: 14 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 376, ep_reward: -37.19310069193673, ep_step: 26 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 377, ep_reward: -13.645453815127578, ep_step: 11 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 378, ep_reward: -6.8881141115137545, ep_step: 12 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 379, ep_reward: -14.291497371312245, ep_step: 11 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 380, ep_reward: -16.92105684025118, ep_step: 25 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 381, ep_reward: -107.6547039823383, ep_step: 81 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 382, ep_reward: -94.9919414545354, ep_step: 49 2023-05-26 14:06:14 - SimpleLog - INFO: - episode: 383, ep_reward: -19.26478157370678, ep_step: 20 2023-05-26 14:06:17 - SimpleLog - INFO: - episode: 384, ep_reward: -1560.5844751951222, ep_step: 1000 2023-05-26 14:06:17 - SimpleLog - INFO: - episode: 385, ep_reward: -48.643175070222505, ep_step: 31 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 386, ep_reward: -235.50402131859937, ep_step: 105 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 387, ep_reward: -108.59469101710624, ep_step: 67 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 388, ep_reward: -50.26530996328191, ep_step: 57 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 389, ep_reward: -25.446283777587375, ep_step: 25 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 390, ep_reward: -47.93612798242099, ep_step: 35 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 391, ep_reward: -47.38505551201078, ep_step: 32 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 392, ep_reward: -19.0380042070771, ep_step: 28 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 393, ep_reward: -44.5103346290159, ep_step: 28 2023-05-26 14:06:18 - SimpleLog - INFO: - episode: 394, ep_reward: -107.37053258946166, ep_step: 59 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 395, ep_reward: -42.78786523490837, ep_step: 25 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 396, ep_reward: -100.46869455170234, ep_step: 67 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 397, ep_reward: -21.804250555581817, ep_step: 16 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 398, ep_reward: -29.920861755255416, ep_step: 18 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 399, ep_reward: -67.0984543597345, ep_step: 42 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 400, ep_reward: -105.10316535397531, ep_step: 46 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 401, ep_reward: -42.229452611170096, ep_step: 23 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 402, ep_reward: -39.63014563362665, ep_step: 21 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 403, ep_reward: -47.52949847269036, ep_step: 49 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 404, ep_reward: -17.64473304250408, ep_step: 12 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 405, ep_reward: -20.02468524430033, ep_step: 18 2023-05-26 14:06:19 - SimpleLog - INFO: - episode: 406, ep_reward: -72.59981407802609, ep_step: 48 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 407, ep_reward: -71.71674063835297, ep_step: 28 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 408, ep_reward: -27.905431711649495, ep_step: 22 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 409, ep_reward: -107.6285805534953, ep_step: 52 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 410, ep_reward: -25.35941204928423, ep_step: 16 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 411, ep_reward: -11.539853738752255, ep_step: 11 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 412, ep_reward: -26.666093726826226, ep_step: 22 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 413, ep_reward: -21.08127486444479, ep_step: 14 2023-05-26 14:06:20 - SimpleLog - INFO: - episode: 414, ep_reward: -46.00238710003941, ep_step: 32 2023-05-26 14:06:23 - SimpleLog - INFO: - episode: 415, ep_reward: -1517.1264490874844, ep_step: 1000 2023-05-26 14:06:23 - SimpleLog - INFO: - episode: 416, ep_reward: -87.86379907410998, ep_step: 67 2023-05-26 14:06:23 - SimpleLog - INFO: - episode: 417, ep_reward: -50.94941899212522, ep_step: 28 2023-05-26 14:06:23 - SimpleLog - INFO: - episode: 418, ep_reward: -68.6191867155093, ep_step: 66 2023-05-26 14:06:23 - SimpleLog - INFO: - episode: 419, ep_reward: -52.205617522186635, ep_step: 52 2023-05-26 14:06:26 - SimpleLog - INFO: - episode: 420, ep_reward: -1636.559645036942, ep_step: 1000 2023-05-26 14:06:26 - SimpleLog - INFO: - episode: 421, ep_reward: -49.7366003032357, ep_step: 27 2023-05-26 14:06:26 - SimpleLog - INFO: - episode: 422, ep_reward: -137.50117050653202, ep_step: 79 2023-05-26 14:06:27 - SimpleLog - INFO: - episode: 423, ep_reward: -20.420399880578618, ep_step: 16 2023-05-26 14:06:27 - SimpleLog - INFO: - episode: 424, ep_reward: -36.072253776159535, ep_step: 32 2023-05-26 14:06:27 - SimpleLog - INFO: - episode: 425, ep_reward: -157.36158408655317, ep_step: 113 2023-05-26 14:06:27 - SimpleLog - INFO: - episode: 426, ep_reward: -45.704413226355335, ep_step: 24 2023-05-26 14:06:27 - SimpleLog - INFO: - episode: 427, ep_reward: -20.162705154261683, ep_step: 11 2023-05-26 14:06:27 - SimpleLog - INFO: - episode: 428, ep_reward: -66.62587627717588, ep_step: 40 2023-05-26 14:06:27 - SimpleLog - INFO: - episode: 429, ep_reward: -64.49545506143167, ep_step: 35 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 430, ep_reward: -77.67189636450449, ep_step: 88 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 431, ep_reward: -43.768405910989735, ep_step: 22 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 432, ep_reward: -16.035039266116268, ep_step: 13 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 433, ep_reward: -21.665880095514424, ep_step: 14 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 434, ep_reward: -26.23365532138449, ep_step: 30 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 435, ep_reward: -7.551140516212014, ep_step: 13 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 436, ep_reward: -42.207233461033255, ep_step: 25 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 437, ep_reward: -24.242229986608432, ep_step: 28 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 438, ep_reward: -26.36365429517941, ep_step: 32 2023-05-26 14:06:28 - SimpleLog - INFO: - episode: 439, ep_reward: -72.44562482671894, ep_step: 41 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 440, ep_reward: -116.55543921166479, ep_step: 68 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 441, ep_reward: -69.47294695451177, ep_step: 54 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 442, ep_reward: -60.420288903483154, ep_step: 33 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 443, ep_reward: -82.18082104970266, ep_step: 43 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 444, ep_reward: -14.075584787108204, ep_step: 16 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 445, ep_reward: -147.7710018897615, ep_step: 103 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 446, ep_reward: -25.666476701563933, ep_step: 33 2023-05-26 14:06:29 - SimpleLog - INFO: - episode: 447, ep_reward: -57.99889121268486, ep_step: 56 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 448, ep_reward: -63.94448131725988, ep_step: 35 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 449, ep_reward: -17.21852046199743, ep_step: 11 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 450, ep_reward: -37.14041456665809, ep_step: 24 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 451, ep_reward: -139.761934009094, ep_step: 51 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 452, ep_reward: -107.30350918075747, ep_step: 54 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 453, ep_reward: -107.04297570718789, ep_step: 62 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 454, ep_reward: -109.0185073378886, ep_step: 47 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 455, ep_reward: -52.00433664139343, ep_step: 31 2023-05-26 14:06:30 - SimpleLog - INFO: - episode: 456, ep_reward: -70.90980643920287, ep_step: 33 2023-05-26 14:06:31 - SimpleLog - INFO: - episode: 457, ep_reward: -47.68034082848453, ep_step: 41 2023-05-26 14:06:31 - SimpleLog - INFO: - episode: 458, ep_reward: -27.06524381085417, ep_step: 19 2023-05-26 14:06:31 - SimpleLog - INFO: - episode: 459, ep_reward: -17.882800541890532, ep_step: 19 2023-05-26 14:06:31 - SimpleLog - INFO: - episode: 460, ep_reward: -168.18572774338787, ep_step: 77 2023-05-26 14:06:34 - SimpleLog - INFO: - episode: 461, ep_reward: -1617.308378339417, ep_step: 1000 2023-05-26 14:06:34 - SimpleLog - INFO: - episode: 462, ep_reward: -18.155478028918736, ep_step: 12 2023-05-26 14:06:34 - SimpleLog - INFO: - episode: 463, ep_reward: -88.187860579999, ep_step: 85 2023-05-26 14:06:34 - SimpleLog - INFO: - episode: 464, ep_reward: -11.313869016311699, ep_step: 11 2023-05-26 14:06:34 - SimpleLog - INFO: - episode: 465, ep_reward: -20.15756232692154, ep_step: 12 2023-05-26 14:06:34 - SimpleLog - INFO: - episode: 466, ep_reward: -66.5151126173856, ep_step: 35 2023-05-26 14:06:37 - SimpleLog - INFO: - episode: 467, ep_reward: -1570.0753912310392, ep_step: 1000 2023-05-26 14:06:37 - SimpleLog - INFO: - episode: 468, ep_reward: -42.20025325523229, ep_step: 73 2023-05-26 14:06:37 - SimpleLog - INFO: - episode: 469, ep_reward: -29.626843537005833, ep_step: 28 2023-05-26 14:06:37 - SimpleLog - INFO: - episode: 470, ep_reward: -86.988684688256, ep_step: 69 2023-05-26 14:06:37 - SimpleLog - INFO: - episode: 471, ep_reward: -28.021173640656176, ep_step: 26 2023-05-26 14:06:37 - SimpleLog - INFO: - episode: 472, ep_reward: -22.507036889491925, ep_step: 17 2023-05-26 14:06:37 - SimpleLog - INFO: - episode: 473, ep_reward: -27.94780565388822, ep_step: 19 2023-05-26 14:06:40 - SimpleLog - INFO: - episode: 474, ep_reward: -1622.4754878943056, ep_step: 1000 2023-05-26 14:06:40 - SimpleLog - INFO: - episode: 475, ep_reward: -28.07706907100629, ep_step: 20 2023-05-26 14:06:40 - SimpleLog - INFO: - episode: 476, ep_reward: -7.635967087052435, ep_step: 12 2023-05-26 14:06:40 - SimpleLog - INFO: - episode: 477, ep_reward: -8.151588163377962, ep_step: 13 2023-05-26 14:06:41 - SimpleLog - INFO: - episode: 478, ep_reward: -149.8319499729295, ep_step: 60 2023-05-26 14:06:41 - SimpleLog - INFO: - episode: 479, ep_reward: -26.711548036337188, ep_step: 21 2023-05-26 14:06:41 - SimpleLog - INFO: - episode: 480, ep_reward: -130.5823816538008, ep_step: 79 2023-05-26 14:06:41 - SimpleLog - INFO: - episode: 481, ep_reward: -118.70725181697117, ep_step: 64 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 482, ep_reward: -289.4254112728339, ep_step: 223 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 483, ep_reward: -120.77097382242403, ep_step: 71 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 484, ep_reward: -56.57036068371145, ep_step: 30 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 485, ep_reward: -18.223267272454713, ep_step: 12 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 486, ep_reward: -80.98267832809513, ep_step: 42 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 487, ep_reward: -38.24232554541878, ep_step: 33 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 488, ep_reward: -52.30116901750568, ep_step: 30 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 489, ep_reward: -22.8113256359704, ep_step: 16 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 490, ep_reward: -27.335702049642034, ep_step: 17 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 491, ep_reward: -40.765068255842806, ep_step: 23 2023-05-26 14:06:42 - SimpleLog - INFO: - episode: 492, ep_reward: -62.640143457482445, ep_step: 34 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 493, ep_reward: -40.80094594782635, ep_step: 45 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 494, ep_reward: -18.542020671550173, ep_step: 10 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 495, ep_reward: -102.74586047258113, ep_step: 50 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 496, ep_reward: -77.88179916307757, ep_step: 53 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 497, ep_reward: -16.946310202721058, ep_step: 16 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 498, ep_reward: -21.303104652818384, ep_step: 14 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 499, ep_reward: -47.81335862682247, ep_step: 41 2023-05-26 14:06:43 - SimpleLog - INFO: - episode: 500, ep_reward: -107.03309692190601, ep_step: 76 2023-05-26 14:06:44 - SimpleLog - INFO: - episode: 501, ep_reward: -60.50719007279243, ep_step: 43 2023-05-26 14:06:44 - SimpleLog - INFO: - episode: 502, ep_reward: -65.22430781021643, ep_step: 36 2023-05-26 14:06:44 - SimpleLog - INFO: - episode: 503, ep_reward: -17.64955702277048, ep_step: 11 2023-05-26 14:06:44 - SimpleLog - INFO: - episode: 504, ep_reward: -10.049649523417807, ep_step: 13 2023-05-26 14:06:44 - SimpleLog - INFO: - episode: 505, ep_reward: -66.51190186888532, ep_step: 47 2023-05-26 14:06:44 - SimpleLog - INFO: - episode: 506, ep_reward: -11.868231357700258, ep_step: 10 2023-05-26 14:06:47 - SimpleLog - INFO: - episode: 507, ep_reward: -1635.7227050978718, ep_step: 1000 2023-05-26 14:06:47 - SimpleLog - INFO: - episode: 508, ep_reward: -303.9027995199824, ep_step: 163 2023-05-26 14:06:47 - SimpleLog - INFO: - episode: 509, ep_reward: -96.63112308793966, ep_step: 44 2023-05-26 14:06:50 - SimpleLog - INFO: - episode: 510, ep_reward: -1631.4707002878138, ep_step: 1000 2023-05-26 14:06:50 - SimpleLog - INFO: - episode: 511, ep_reward: -17.41071750684552, ep_step: 16 2023-05-26 14:06:50 - SimpleLog - INFO: - episode: 512, ep_reward: -19.490368365346143, ep_step: 11 2023-05-26 14:06:50 - SimpleLog - INFO: - episode: 513, ep_reward: -56.89881085443213, ep_step: 33 2023-05-26 14:06:50 - SimpleLog - INFO: - episode: 514, ep_reward: -110.49747879498209, ep_step: 39 2023-05-26 14:06:50 - SimpleLog - INFO: - episode: 515, ep_reward: -42.13240228863968, ep_step: 32 2023-05-26 14:06:51 - SimpleLog - INFO: - episode: 516, ep_reward: -16.325608509468303, ep_step: 14 2023-05-26 14:06:51 - SimpleLog - INFO: - episode: 517, ep_reward: -156.52834671292536, ep_step: 81 2023-05-26 14:06:51 - SimpleLog - INFO: - episode: 518, ep_reward: -39.388531635029864, ep_step: 34 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 519, ep_reward: -676.3450693849272, ep_step: 386 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 520, ep_reward: -25.33078541612945, ep_step: 16 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 521, ep_reward: -38.63870443764838, ep_step: 21 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 522, ep_reward: -40.68208280020777, ep_step: 31 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 523, ep_reward: -70.612502030077, ep_step: 45 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 524, ep_reward: -33.54991648461359, ep_step: 20 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 525, ep_reward: -21.828953766492734, ep_step: 14 2023-05-26 14:06:52 - SimpleLog - INFO: - episode: 526, ep_reward: -42.903087910448285, ep_step: 31 2023-05-26 14:06:55 - SimpleLog - INFO: - episode: 527, ep_reward: -1614.709962801532, ep_step: 1000 2023-05-26 14:06:55 - SimpleLog - INFO: - episode: 528, ep_reward: -17.430632483913037, ep_step: 16 2023-05-26 14:06:55 - SimpleLog - INFO: - episode: 529, ep_reward: -44.075293927541715, ep_step: 53 2023-05-26 14:06:56 - SimpleLog - INFO: - episode: 530, ep_reward: -66.73841700129655, ep_step: 37 2023-05-26 14:06:56 - SimpleLog - INFO: - episode: 531, ep_reward: -101.44701930024823, ep_step: 64 2023-05-26 14:06:56 - SimpleLog - INFO: - episode: 532, ep_reward: -130.25097847450428, ep_step: 118 2023-05-26 14:06:56 - SimpleLog - INFO: - episode: 533, ep_reward: -234.93237026274772, ep_step: 118 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 534, ep_reward: -54.46195425817964, ep_step: 44 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 535, ep_reward: -160.1517317642011, ep_step: 62 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 536, ep_reward: -22.433812056540773, ep_step: 14 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 537, ep_reward: -100.20852412962748, ep_step: 47 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 538, ep_reward: -75.78965682605975, ep_step: 54 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 539, ep_reward: -47.09322246045786, ep_step: 31 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 540, ep_reward: -32.6069358261903, ep_step: 27 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 541, ep_reward: -134.5855893461868, ep_step: 77 2023-05-26 14:06:57 - SimpleLog - INFO: - episode: 542, ep_reward: -50.98472453893935, ep_step: 26 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 543, ep_reward: -83.65523798867441, ep_step: 43 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 544, ep_reward: -14.732333033173099, ep_step: 12 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 545, ep_reward: -123.39318285586168, ep_step: 66 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 546, ep_reward: -14.017052921475647, ep_step: 14 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 547, ep_reward: -101.15623382077048, ep_step: 58 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 548, ep_reward: -12.59552063093923, ep_step: 14 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 549, ep_reward: -164.57491723106418, ep_step: 80 2023-05-26 14:06:58 - SimpleLog - INFO: - episode: 550, ep_reward: -19.859915785189738, ep_step: 11 2023-05-26 14:07:01 - SimpleLog - INFO: - episode: 551, ep_reward: -1648.7763855421385, ep_step: 1000 2023-05-26 14:07:01 - SimpleLog - INFO: - episode: 552, ep_reward: -22.042657293517674, ep_step: 19 2023-05-26 14:07:01 - SimpleLog - INFO: - episode: 553, ep_reward: -61.16889117688874, ep_step: 35 2023-05-26 14:07:01 - SimpleLog - INFO: - episode: 554, ep_reward: -78.09931203904037, ep_step: 47 2023-05-26 14:07:01 - SimpleLog - INFO: - episode: 555, ep_reward: -19.937500241958993, ep_step: 12 2023-05-26 14:07:02 - SimpleLog - INFO: - episode: 556, ep_reward: -231.05803311528072, ep_step: 109 2023-05-26 14:07:02 - SimpleLog - INFO: - episode: 557, ep_reward: -16.041657814848318, ep_step: 13 2023-05-26 14:07:02 - SimpleLog - INFO: - episode: 558, ep_reward: -33.96842905213915, ep_step: 18 2023-05-26 14:07:02 - SimpleLog - INFO: - episode: 559, ep_reward: -65.52321026376524, ep_step: 36 2023-05-26 14:07:05 - SimpleLog - INFO: - episode: 560, ep_reward: -1614.4654425849583, ep_step: 1000 2023-05-26 14:07:09 - SimpleLog - INFO: - episode: 561, ep_reward: -1673.3075439626248, ep_step: 1000 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 562, ep_reward: -1675.3356600480322, ep_step: 1000 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 563, ep_reward: -33.09124352249423, ep_step: 15 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 564, ep_reward: -34.279276638703855, ep_step: 25 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 565, ep_reward: -50.1987690010805, ep_step: 31 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 566, ep_reward: -50.68777044644622, ep_step: 44 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 567, ep_reward: -69.94561494599661, ep_step: 30 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 568, ep_reward: -77.15832433198166, ep_step: 39 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 569, ep_reward: -77.11373562380416, ep_step: 39 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 570, ep_reward: -34.522382103842915, ep_step: 21 2023-05-26 14:07:12 - SimpleLog - INFO: - episode: 571, ep_reward: -155.29468472348537, ep_step: 81 2023-05-26 14:07:13 - SimpleLog - INFO: - episode: 572, ep_reward: -89.41969538370554, ep_step: 69 2023-05-26 14:07:13 - SimpleLog - INFO: - episode: 573, ep_reward: -14.91219228724363, ep_step: 11 2023-05-26 14:07:13 - SimpleLog - INFO: - episode: 574, ep_reward: -171.3799917410594, ep_step: 82 2023-05-26 14:07:13 - SimpleLog - INFO: - episode: 575, ep_reward: -7.489922623799389, ep_step: 11 2023-05-26 14:07:16 - SimpleLog - INFO: - episode: 576, ep_reward: -1577.4359367948355, ep_step: 1000 2023-05-26 14:07:16 - SimpleLog - INFO: - episode: 577, ep_reward: -37.18368190476331, ep_step: 36 2023-05-26 14:07:16 - SimpleLog - INFO: - episode: 578, ep_reward: -69.63455826469469, ep_step: 50 2023-05-26 14:07:16 - SimpleLog - INFO: - episode: 579, ep_reward: -29.668904756841847, ep_step: 15 2023-05-26 14:07:16 - SimpleLog - INFO: - episode: 580, ep_reward: -201.0709726246599, ep_step: 85 2023-05-26 14:07:17 - SimpleLog - INFO: - episode: 581, ep_reward: -39.491494447732485, ep_step: 16 2023-05-26 14:07:17 - SimpleLog - INFO: - episode: 582, ep_reward: -15.552214058680308, ep_step: 21 2023-05-26 14:07:17 - SimpleLog - INFO: - episode: 583, ep_reward: -15.590969790752071, ep_step: 12 2023-05-26 14:07:17 - SimpleLog - INFO: - episode: 584, ep_reward: -18.024288479043808, ep_step: 18 2023-05-26 14:07:17 - SimpleLog - INFO: - episode: 585, ep_reward: -74.7763877262237, ep_step: 28 2023-05-26 14:07:20 - SimpleLog - INFO: - episode: 586, ep_reward: -1561.158442263072, ep_step: 1000 2023-05-26 14:07:20 - SimpleLog - INFO: - episode: 587, ep_reward: -75.59652643300309, ep_step: 43 2023-05-26 14:07:20 - SimpleLog - INFO: - episode: 588, ep_reward: -17.369929629776355, ep_step: 12 2023-05-26 14:07:23 - SimpleLog - INFO: - episode: 589, ep_reward: -1691.9789268050326, ep_step: 1000 2023-05-26 14:07:23 - SimpleLog - INFO: - episode: 590, ep_reward: -51.11674799693966, ep_step: 46 2023-05-26 14:07:23 - SimpleLog - INFO: - episode: 591, ep_reward: -21.983078782195882, ep_step: 11 2023-05-26 14:07:23 - SimpleLog - INFO: - episode: 592, ep_reward: -40.085978692308224, ep_step: 19 2023-05-26 14:07:23 - SimpleLog - INFO: - episode: 593, ep_reward: -28.51661405586266, ep_step: 39 2023-05-26 14:07:23 - SimpleLog - INFO: - episode: 594, ep_reward: -59.501793618206186, ep_step: 29 2023-05-26 14:07:23 - SimpleLog - INFO: - episode: 595, ep_reward: -38.15496824940201, ep_step: 34 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 596, ep_reward: -32.847978149955004, ep_step: 21 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 597, ep_reward: -20.57654176245258, ep_step: 21 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 598, ep_reward: -19.324253507052713, ep_step: 11 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 599, ep_reward: -42.20134679060428, ep_step: 19 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 600, ep_reward: -36.29435680559284, ep_step: 19 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 601, ep_reward: -26.87441815849192, ep_step: 17 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 602, ep_reward: -70.41943777296817, ep_step: 57 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 603, ep_reward: -159.20910773609745, ep_step: 87 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 604, ep_reward: -66.28553439857349, ep_step: 37 2023-05-26 14:07:24 - SimpleLog - INFO: - episode: 605, ep_reward: -46.48035959237052, ep_step: 44 2023-05-26 14:07:25 - SimpleLog - INFO: - episode: 606, ep_reward: -101.19040174277411, ep_step: 62 2023-05-26 14:07:25 - SimpleLog - INFO: - episode: 607, ep_reward: -100.88881632999299, ep_step: 50 2023-05-26 14:07:25 - SimpleLog - INFO: - episode: 608, ep_reward: -185.83584190731767, ep_step: 122 2023-05-26 14:07:28 - SimpleLog - INFO: - episode: 609, ep_reward: -1645.0248279095426, ep_step: 1000 2023-05-26 14:07:28 - SimpleLog - INFO: - episode: 610, ep_reward: -22.19431560190641, ep_step: 15 2023-05-26 14:07:28 - SimpleLog - INFO: - episode: 611, ep_reward: -42.78777226380679, ep_step: 27 2023-05-26 14:07:28 - SimpleLog - INFO: - episode: 612, ep_reward: -47.64091584032063, ep_step: 48 2023-05-26 14:07:28 - SimpleLog - INFO: - episode: 613, ep_reward: -38.615604634387594, ep_step: 24 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 614, ep_reward: -59.6641323923365, ep_step: 69 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 615, ep_reward: -49.28247584699451, ep_step: 17 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 616, ep_reward: -35.027607703169494, ep_step: 23 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 617, ep_reward: -27.15973705413185, ep_step: 15 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 618, ep_reward: -10.443387027859004, ep_step: 19 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 619, ep_reward: -25.240673538755058, ep_step: 23 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 620, ep_reward: -36.41454405094303, ep_step: 14 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 621, ep_reward: -81.42689340142086, ep_step: 33 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 622, ep_reward: -14.631714361865374, ep_step: 13 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 623, ep_reward: -54.25758933202241, ep_step: 26 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 624, ep_reward: -10.426246643741887, ep_step: 12 2023-05-26 14:07:29 - SimpleLog - INFO: - episode: 625, ep_reward: -73.14417603766094, ep_step: 57 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 626, ep_reward: -60.87799769153312, ep_step: 41 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 627, ep_reward: -35.22973099964289, ep_step: 14 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 628, ep_reward: -20.996308919859015, ep_step: 18 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 629, ep_reward: -24.181439594730595, ep_step: 32 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 630, ep_reward: -34.87663072411385, ep_step: 18 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 631, ep_reward: -3.9406568862987026, ep_step: 14 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 632, ep_reward: -101.34910526925852, ep_step: 44 2023-05-26 14:07:30 - SimpleLog - INFO: - episode: 633, ep_reward: -36.3110000949029, ep_step: 24 2023-05-26 14:07:33 - SimpleLog - INFO: - episode: 634, ep_reward: -1589.8721036195793, ep_step: 1000 2023-05-26 14:07:33 - SimpleLog - INFO: - episode: 635, ep_reward: -34.24563636759855, ep_step: 40 2023-05-26 14:07:33 - SimpleLog - INFO: - episode: 636, ep_reward: -22.534304909071533, ep_step: 14 2023-05-26 14:07:33 - SimpleLog - INFO: - episode: 637, ep_reward: -39.06169355269273, ep_step: 26 2023-05-26 14:07:33 - SimpleLog - INFO: - episode: 638, ep_reward: -8.407034596638292, ep_step: 12 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 639, ep_reward: -134.69925244614438, ep_step: 76 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 640, ep_reward: -163.79235404937089, ep_step: 98 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 641, ep_reward: -95.01343450241411, ep_step: 44 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 642, ep_reward: -108.57910777049906, ep_step: 67 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 643, ep_reward: -9.689510313075747, ep_step: 8 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 644, ep_reward: -12.051876101086012, ep_step: 15 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 645, ep_reward: -18.944098305608247, ep_step: 27 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 646, ep_reward: -53.83471398268952, ep_step: 32 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 647, ep_reward: -17.634726170532662, ep_step: 12 2023-05-26 14:07:34 - SimpleLog - INFO: - episode: 648, ep_reward: -17.1085281761055, ep_step: 14 2023-05-26 14:07:35 - SimpleLog - INFO: - episode: 649, ep_reward: -124.70224891644254, ep_step: 78 2023-05-26 14:07:37 - SimpleLog - INFO: - episode: 650, ep_reward: -1728.5660165091344, ep_step: 998 2023-05-26 14:07:38 - SimpleLog - INFO: - episode: 651, ep_reward: -144.9243443662964, ep_step: 78 2023-05-26 14:07:38 - SimpleLog - INFO: - episode: 652, ep_reward: -20.53769635238084, ep_step: 17 2023-05-26 14:07:38 - SimpleLog - INFO: - episode: 653, ep_reward: -186.0829074267039, ep_step: 86 2023-05-26 14:07:38 - SimpleLog - INFO: - episode: 654, ep_reward: -35.78719078477252, ep_step: 24 2023-05-26 14:07:38 - SimpleLog - INFO: - episode: 655, ep_reward: -67.16057813446952, ep_step: 38 2023-05-26 14:07:38 - SimpleLog - INFO: - episode: 656, ep_reward: -27.91442480274182, ep_step: 16 2023-05-26 14:07:38 - SimpleLog - INFO: - episode: 657, ep_reward: -104.44973304840336, ep_step: 67 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 658, ep_reward: -20.184329186532324, ep_step: 11 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 659, ep_reward: -42.79033077257538, ep_step: 19 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 660, ep_reward: -46.146218912224455, ep_step: 24 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 661, ep_reward: -93.69807552108588, ep_step: 46 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 662, ep_reward: -76.74913599192838, ep_step: 36 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 663, ep_reward: -145.50674402218166, ep_step: 70 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 664, ep_reward: -145.71283115368638, ep_step: 89 2023-05-26 14:07:39 - SimpleLog - INFO: - episode: 665, ep_reward: -30.38470066112064, ep_step: 32 2023-05-26 14:07:42 - SimpleLog - INFO: - episode: 666, ep_reward: -1683.9688882398243, ep_step: 1000 2023-05-26 14:07:42 - SimpleLog - INFO: - episode: 667, ep_reward: -14.646720379722103, ep_step: 13 2023-05-26 14:07:43 - SimpleLog - INFO: - episode: 668, ep_reward: -121.07587230843738, ep_step: 61 2023-05-26 14:07:43 - SimpleLog - INFO: - episode: 669, ep_reward: -74.45192742175004, ep_step: 25 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 670, ep_reward: -1687.3621703589768, ep_step: 1000 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 671, ep_reward: -59.02531844124924, ep_step: 34 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 672, ep_reward: -119.14297033554725, ep_step: 57 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 673, ep_reward: -16.955424453103344, ep_step: 13 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 674, ep_reward: -12.29762807886955, ep_step: 13 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 675, ep_reward: -50.87530476763878, ep_step: 41 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 676, ep_reward: -112.98295669958034, ep_step: 52 2023-05-26 14:07:46 - SimpleLog - INFO: - episode: 677, ep_reward: -38.22260211538668, ep_step: 32 2023-05-26 14:07:47 - SimpleLog - INFO: - episode: 678, ep_reward: -177.44739338812894, ep_step: 109 2023-05-26 14:07:47 - SimpleLog - INFO: - episode: 679, ep_reward: -83.51981312312427, ep_step: 51 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 680, ep_reward: -1737.939103756172, ep_step: 1000 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 681, ep_reward: -47.23326475103325, ep_step: 28 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 682, ep_reward: -15.60361479498768, ep_step: 11 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 683, ep_reward: -12.216672230093998, ep_step: 15 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 684, ep_reward: -20.653248552577423, ep_step: 30 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 685, ep_reward: -22.430201224641834, ep_step: 9 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 686, ep_reward: -78.01841945482619, ep_step: 47 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 687, ep_reward: -27.91705613519464, ep_step: 17 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 688, ep_reward: -22.139306906867148, ep_step: 16 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 689, ep_reward: -79.15297384749563, ep_step: 38 2023-05-26 14:07:50 - SimpleLog - INFO: - episode: 690, ep_reward: -18.291304809271285, ep_step: 18 2023-05-26 14:07:53 - SimpleLog - INFO: - episode: 691, ep_reward: -1659.3899847680918, ep_step: 1000 2023-05-26 14:07:53 - SimpleLog - INFO: - episode: 692, ep_reward: -12.331152464582953, ep_step: 9 2023-05-26 14:07:53 - SimpleLog - INFO: - episode: 693, ep_reward: -88.53069275954962, ep_step: 42 2023-05-26 14:07:53 - SimpleLog - INFO: - episode: 694, ep_reward: -54.08978575640224, ep_step: 21 2023-05-26 14:07:54 - SimpleLog - INFO: - episode: 695, ep_reward: -61.343243319180615, ep_step: 39 2023-05-26 14:07:54 - SimpleLog - INFO: - episode: 696, ep_reward: -39.199024905086134, ep_step: 22 2023-05-26 14:07:54 - SimpleLog - INFO: - episode: 697, ep_reward: -17.795364783403265, ep_step: 13 2023-05-26 14:07:54 - SimpleLog - INFO: - episode: 698, ep_reward: -272.5972398485485, ep_step: 146 2023-05-26 14:07:54 - SimpleLog - INFO: - episode: 699, ep_reward: -149.43313331616127, ep_step: 82 2023-05-26 14:07:54 - SimpleLog - INFO: - episode: 700, ep_reward: -45.570533219730265, ep_step: 54 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 701, ep_reward: -66.12128169560651, ep_step: 37 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 702, ep_reward: -47.60612674149226, ep_step: 20 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 703, ep_reward: -144.6289996676009, ep_step: 105 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 704, ep_reward: -103.33489602190882, ep_step: 55 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 705, ep_reward: -22.951692578541557, ep_step: 12 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 706, ep_reward: -68.60433377978393, ep_step: 30 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 707, ep_reward: -64.47737018440958, ep_step: 29 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 708, ep_reward: -25.838395919180105, ep_step: 18 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 709, ep_reward: -31.265247479986456, ep_step: 22 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 710, ep_reward: -30.088625578807424, ep_step: 32 2023-05-26 14:07:55 - SimpleLog - INFO: - episode: 711, ep_reward: -50.062003140090155, ep_step: 24 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 712, ep_reward: -24.2096193997288, ep_step: 29 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 713, ep_reward: -9.569502880895794, ep_step: 12 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 714, ep_reward: -17.997244002492476, ep_step: 11 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 715, ep_reward: -89.19030832993928, ep_step: 49 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 716, ep_reward: -60.091462797761956, ep_step: 36 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 717, ep_reward: -33.04574503542285, ep_step: 16 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 718, ep_reward: -17.796053285138647, ep_step: 15 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 719, ep_reward: -70.1631294882671, ep_step: 45 2023-05-26 14:07:56 - SimpleLog - INFO: - episode: 720, ep_reward: -48.37977163105338, ep_step: 20 2023-05-26 14:07:57 - SimpleLog - INFO: - episode: 721, ep_reward: -145.88263403424426, ep_step: 89 2023-05-26 14:07:57 - SimpleLog - INFO: - episode: 722, ep_reward: -84.02040144150199, ep_step: 47 2023-05-26 14:07:57 - SimpleLog - INFO: - episode: 723, ep_reward: -43.56603847904786, ep_step: 29 2023-05-26 14:07:57 - SimpleLog - INFO: - episode: 724, ep_reward: -17.769500050090635, ep_step: 10 2023-05-26 14:07:57 - SimpleLog - INFO: - episode: 725, ep_reward: -30.78883430504188, ep_step: 16 2023-05-26 14:07:57 - SimpleLog - INFO: - episode: 726, ep_reward: -41.17253823229705, ep_step: 23 2023-05-26 14:08:00 - SimpleLog - INFO: - episode: 727, ep_reward: -1598.8135606893923, ep_step: 1000 2023-05-26 14:08:00 - SimpleLog - INFO: - episode: 728, ep_reward: -26.729902409825847, ep_step: 19 2023-05-26 14:08:00 - SimpleLog - INFO: - episode: 729, ep_reward: -53.25739206537528, ep_step: 36 2023-05-26 14:08:00 - SimpleLog - INFO: - episode: 730, ep_reward: -21.1416430955656, ep_step: 16 2023-05-26 14:08:03 - SimpleLog - INFO: - episode: 731, ep_reward: -1619.4324373175095, ep_step: 1000 2023-05-26 14:08:03 - SimpleLog - INFO: - episode: 732, ep_reward: -107.6760132206508, ep_step: 37 2023-05-26 14:08:06 - SimpleLog - INFO: - episode: 733, ep_reward: -1291.019364238578, ep_step: 819 2023-05-26 14:08:06 - SimpleLog - INFO: - episode: 734, ep_reward: -50.17711249344555, ep_step: 26 2023-05-26 14:08:06 - SimpleLog - INFO: - episode: 735, ep_reward: -27.002407296170247, ep_step: 13 2023-05-26 14:08:06 - SimpleLog - INFO: - episode: 736, ep_reward: -102.03930423853161, ep_step: 45 2023-05-26 14:08:06 - SimpleLog - INFO: - episode: 737, ep_reward: -20.342482487022536, ep_step: 14 2023-05-26 14:08:06 - SimpleLog - INFO: - episode: 738, ep_reward: -172.85916457489316, ep_step: 106 2023-05-26 14:08:06 - SimpleLog - INFO: - episode: 739, ep_reward: -32.4695594802312, ep_step: 20 2023-05-26 14:08:07 - SimpleLog - INFO: - episode: 740, ep_reward: -69.56875189561822, ep_step: 35 2023-05-26 14:08:07 - SimpleLog - INFO: - episode: 741, ep_reward: -86.23813109818306, ep_step: 43 2023-05-26 14:08:07 - SimpleLog - INFO: - episode: 742, ep_reward: -64.95063856147003, ep_step: 54 2023-05-26 14:08:07 - SimpleLog - INFO: - episode: 743, ep_reward: -62.7130139226073, ep_step: 42 2023-05-26 14:08:07 - SimpleLog - INFO: - episode: 744, ep_reward: -123.66069080703855, ep_step: 97 2023-05-26 14:08:07 - SimpleLog - INFO: - episode: 745, ep_reward: -66.12712299459234, ep_step: 34 2023-05-26 14:08:07 - SimpleLog - INFO: - episode: 746, ep_reward: -13.451075991186293, ep_step: 11 2023-05-26 14:08:10 - SimpleLog - INFO: - episode: 747, ep_reward: -1688.4379202176926, ep_step: 1000 2023-05-26 14:08:10 - SimpleLog - INFO: - episode: 748, ep_reward: -18.098596031898325, ep_step: 22 2023-05-26 14:08:10 - SimpleLog - INFO: - episode: 749, ep_reward: -66.91251009613963, ep_step: 30 2023-05-26 14:08:10 - SimpleLog - INFO: - episode: 750, ep_reward: -67.71330794748081, ep_step: 56 2023-05-26 14:08:11 - SimpleLog - INFO: - episode: 751, ep_reward: -143.74141696432022, ep_step: 71 2023-05-26 14:08:11 - SimpleLog - INFO: - episode: 752, ep_reward: -29.874627997033215, ep_step: 19 2023-05-26 14:08:11 - SimpleLog - INFO: - episode: 753, ep_reward: -91.61184095924398, ep_step: 58 2023-05-26 14:08:11 - SimpleLog - INFO: - episode: 754, ep_reward: -208.98812478807343, ep_step: 99 2023-05-26 14:08:11 - SimpleLog - INFO: - episode: 755, ep_reward: -20.151895013643013, ep_step: 10 2023-05-26 14:08:11 - SimpleLog - INFO: - episode: 756, ep_reward: -25.29114463641085, ep_step: 25 2023-05-26 14:08:12 - SimpleLog - INFO: - episode: 757, ep_reward: -207.3677672381568, ep_step: 113 2023-05-26 14:08:12 - SimpleLog - INFO: - episode: 758, ep_reward: -196.8735175300514, ep_step: 153 2023-05-26 14:08:12 - SimpleLog - INFO: - episode: 759, ep_reward: -118.47456060817396, ep_step: 75 2023-05-26 14:08:12 - SimpleLog - INFO: - episode: 760, ep_reward: -16.60407315206143, ep_step: 15 2023-05-26 14:08:13 - SimpleLog - INFO: - episode: 761, ep_reward: -68.73533826138524, ep_step: 32 2023-05-26 14:08:13 - SimpleLog - INFO: - episode: 762, ep_reward: -55.0888555284192, ep_step: 53 2023-05-26 14:08:13 - SimpleLog - INFO: - episode: 763, ep_reward: -31.838432233537695, ep_step: 18 2023-05-26 14:08:16 - SimpleLog - INFO: - episode: 764, ep_reward: -1692.138745786623, ep_step: 1000 2023-05-26 14:08:16 - SimpleLog - INFO: - episode: 765, ep_reward: -29.14677162097908, ep_step: 20 2023-05-26 14:08:16 - SimpleLog - INFO: - episode: 766, ep_reward: -20.33116497001533, ep_step: 16 2023-05-26 14:08:16 - SimpleLog - INFO: - episode: 767, ep_reward: -22.93437078016139, ep_step: 32 2023-05-26 14:08:16 - SimpleLog - INFO: - episode: 768, ep_reward: -193.07839546308944, ep_step: 136 2023-05-26 14:08:16 - SimpleLog - INFO: - episode: 769, ep_reward: -126.5074065004489, ep_step: 67 2023-05-26 14:08:17 - SimpleLog - INFO: - episode: 770, ep_reward: -55.76403302045814, ep_step: 34 2023-05-26 14:08:17 - SimpleLog - INFO: - episode: 771, ep_reward: -64.07642272829615, ep_step: 41 2023-05-26 14:08:20 - SimpleLog - INFO: - episode: 772, ep_reward: -1645.1626218264776, ep_step: 1000 2023-05-26 14:08:20 - SimpleLog - INFO: - episode: 773, ep_reward: -27.40297399426391, ep_step: 16 2023-05-26 14:08:20 - SimpleLog - INFO: - episode: 774, ep_reward: -18.945866022252766, ep_step: 10 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 775, ep_reward: -1662.876695821778, ep_step: 1000 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 776, ep_reward: -49.59207591282277, ep_step: 30 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 777, ep_reward: -111.42768360116555, ep_step: 54 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 778, ep_reward: -62.20287249586785, ep_step: 21 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 779, ep_reward: -63.55019213247804, ep_step: 34 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 780, ep_reward: -40.793041190461466, ep_step: 18 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 781, ep_reward: -23.607046377922327, ep_step: 14 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 782, ep_reward: -16.478726029979356, ep_step: 16 2023-05-26 14:08:23 - SimpleLog - INFO: - episode: 783, ep_reward: -135.77664408892332, ep_step: 45 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 784, ep_reward: -52.62409040858465, ep_step: 43 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 785, ep_reward: -28.22985859783511, ep_step: 13 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 786, ep_reward: -18.583006055262768, ep_step: 32 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 787, ep_reward: -75.67387214413898, ep_step: 44 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 788, ep_reward: -47.54663497260032, ep_step: 35 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 789, ep_reward: -188.92596477279625, ep_step: 59 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 790, ep_reward: -67.48808554105652, ep_step: 38 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 791, ep_reward: -16.475166774331036, ep_step: 15 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 792, ep_reward: -35.230260933381814, ep_step: 20 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 793, ep_reward: -77.1231499019975, ep_step: 39 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 794, ep_reward: -25.232015626360273, ep_step: 11 2023-05-26 14:08:24 - SimpleLog - INFO: - episode: 795, ep_reward: -25.58204412946493, ep_step: 21 2023-05-26 14:08:25 - SimpleLog - INFO: - episode: 796, ep_reward: -13.362029081304655, ep_step: 22 2023-05-26 14:08:25 - SimpleLog - INFO: - episode: 797, ep_reward: -72.02636714338061, ep_step: 63 2023-05-26 14:08:26 - SimpleLog - INFO: - episode: 798, ep_reward: -713.0978620844569, ep_step: 432 2023-05-26 14:08:26 - SimpleLog - INFO: - episode: 799, ep_reward: -191.48013107145272, ep_step: 76 2023-05-26 14:08:26 - SimpleLog - INFO: - episode: 800, ep_reward: -22.902333171141702, ep_step: 19 2023-05-26 14:08:26 - SimpleLog - INFO: - episode: 801, ep_reward: -95.07544513501101, ep_step: 36 2023-05-26 14:08:26 - SimpleLog - INFO: - episode: 802, ep_reward: -65.65529217000267, ep_step: 58 2023-05-26 14:08:29 - SimpleLog - INFO: - episode: 803, ep_reward: -1702.2735771588584, ep_step: 1000 2023-05-26 14:08:29 - SimpleLog - INFO: - episode: 804, ep_reward: -30.9380960183258, ep_step: 21 2023-05-26 14:08:29 - SimpleLog - INFO: - episode: 805, ep_reward: -33.902092356887074, ep_step: 15 2023-05-26 14:08:29 - SimpleLog - INFO: - episode: 806, ep_reward: -45.94333604199677, ep_step: 22 2023-05-26 14:08:30 - SimpleLog - INFO: - episode: 807, ep_reward: -81.90386631879323, ep_step: 49 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 808, ep_reward: -1699.038867437165, ep_step: 1000 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 809, ep_reward: -36.66806910286489, ep_step: 33 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 810, ep_reward: -47.70678384065556, ep_step: 27 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 811, ep_reward: -18.443204671464837, ep_step: 9 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 812, ep_reward: -53.651024661225115, ep_step: 35 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 813, ep_reward: -34.28444097855443, ep_step: 32 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 814, ep_reward: -85.77351432483279, ep_step: 53 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 815, ep_reward: -13.272750394219068, ep_step: 11 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 816, ep_reward: -13.001089922205868, ep_step: 11 2023-05-26 14:08:33 - SimpleLog - INFO: - episode: 817, ep_reward: -26.36614933161253, ep_step: 34 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 818, ep_reward: -136.05196077625718, ep_step: 65 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 819, ep_reward: -28.400586148493982, ep_step: 15 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 820, ep_reward: -35.760739517740454, ep_step: 19 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 821, ep_reward: -31.287207847803106, ep_step: 17 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 822, ep_reward: -54.23998233853534, ep_step: 34 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 823, ep_reward: -64.85139447133157, ep_step: 33 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 824, ep_reward: -56.484515153131866, ep_step: 46 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 825, ep_reward: -29.2524867852491, ep_step: 15 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 826, ep_reward: -20.40579519143505, ep_step: 15 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 827, ep_reward: -55.52085508491847, ep_step: 30 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 828, ep_reward: -75.50054386211514, ep_step: 33 2023-05-26 14:08:34 - SimpleLog - INFO: - episode: 829, ep_reward: -114.09729526758939, ep_step: 44 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 830, ep_reward: -121.7789251979385, ep_step: 51 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 831, ep_reward: -19.475908522708117, ep_step: 10 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 832, ep_reward: -20.344536376871826, ep_step: 21 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 833, ep_reward: -7.925763775720382, ep_step: 12 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 834, ep_reward: -40.23210574061212, ep_step: 18 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 835, ep_reward: -20.56662857667459, ep_step: 22 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 836, ep_reward: -17.788062565745637, ep_step: 23 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 837, ep_reward: -52.9745988195032, ep_step: 22 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 838, ep_reward: -74.73073440245541, ep_step: 49 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 839, ep_reward: -16.210110405172127, ep_step: 14 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 840, ep_reward: -38.74706644775758, ep_step: 20 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 841, ep_reward: -39.00753857302165, ep_step: 29 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 842, ep_reward: -85.12917618927237, ep_step: 28 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 843, ep_reward: -15.32188452587167, ep_step: 11 2023-05-26 14:08:35 - SimpleLog - INFO: - episode: 844, ep_reward: -73.25714425207742, ep_step: 31 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 845, ep_reward: -92.14464068938149, ep_step: 75 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 846, ep_reward: -15.226843327137566, ep_step: 13 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 847, ep_reward: -22.562723107741107, ep_step: 13 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 848, ep_reward: -53.505084903573156, ep_step: 30 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 849, ep_reward: -106.16528696637965, ep_step: 60 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 850, ep_reward: -137.68950342845034, ep_step: 70 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 851, ep_reward: -18.73216043849757, ep_step: 10 2023-05-26 14:08:36 - SimpleLog - INFO: - episode: 852, ep_reward: -86.7916869661411, ep_step: 45 2023-05-26 14:08:37 - SimpleLog - INFO: - episode: 853, ep_reward: -129.41437267499805, ep_step: 76 2023-05-26 14:08:37 - SimpleLog - INFO: - episode: 854, ep_reward: -27.694201353557084, ep_step: 17 2023-05-26 14:08:37 - SimpleLog - INFO: - episode: 855, ep_reward: -41.01629531683128, ep_step: 27 2023-05-26 14:08:37 - SimpleLog - INFO: - episode: 856, ep_reward: -17.42464579904877, ep_step: 11 2023-05-26 14:08:37 - SimpleLog - INFO: - episode: 857, ep_reward: -44.70589832312833, ep_step: 28 2023-05-26 14:08:37 - SimpleLog - INFO: - episode: 858, ep_reward: -20.855596089580683, ep_step: 19 2023-05-26 14:08:37 - SimpleLog - INFO: - episode: 859, ep_reward: -65.39655528728453, ep_step: 24 2023-05-26 14:08:38 - SimpleLog - INFO: - episode: 860, ep_reward: -625.3751540700325, ep_step: 385 2023-05-26 14:08:38 - SimpleLog - INFO: - episode: 861, ep_reward: -16.231074221418098, ep_step: 12 2023-05-26 14:08:38 - SimpleLog - INFO: - episode: 862, ep_reward: -59.73766797036154, ep_step: 53 2023-05-26 14:08:38 - SimpleLog - INFO: - episode: 863, ep_reward: -42.28536839745847, ep_step: 19 2023-05-26 14:08:38 - SimpleLog - INFO: - episode: 864, ep_reward: -37.09355908674468, ep_step: 30 2023-05-26 14:08:38 - SimpleLog - INFO: - episode: 865, ep_reward: -56.485714709107164, ep_step: 30 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 866, ep_reward: -91.48299689276533, ep_step: 53 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 867, ep_reward: -29.407166638629004, ep_step: 16 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 868, ep_reward: -105.08228228047437, ep_step: 68 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 869, ep_reward: -36.577626738455564, ep_step: 32 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 870, ep_reward: -44.68593971826283, ep_step: 28 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 871, ep_reward: -144.79777660984715, ep_step: 74 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 872, ep_reward: -33.153479225664, ep_step: 21 2023-05-26 14:08:39 - SimpleLog - INFO: - episode: 873, ep_reward: -22.0194485390574, ep_step: 24 2023-05-26 14:08:42 - SimpleLog - INFO: - episode: 874, ep_reward: -1765.074113826862, ep_step: 1000 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 875, ep_reward: -35.389472773985716, ep_step: 31 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 876, ep_reward: -31.080898098101066, ep_step: 19 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 877, ep_reward: -43.20577933019342, ep_step: 18 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 878, ep_reward: -100.03265890637348, ep_step: 33 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 879, ep_reward: -32.56535062329973, ep_step: 24 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 880, ep_reward: -105.63006621534088, ep_step: 57 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 881, ep_reward: -36.52318241840583, ep_step: 23 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 882, ep_reward: -36.11006560262936, ep_step: 27 2023-05-26 14:08:43 - SimpleLog - INFO: - episode: 883, ep_reward: -124.15835542653552, ep_step: 55 2023-05-26 14:08:46 - SimpleLog - INFO: - episode: 884, ep_reward: -1657.731807472175, ep_step: 1000 2023-05-26 14:08:46 - SimpleLog - INFO: - episode: 885, ep_reward: -26.907659583365845, ep_step: 17 2023-05-26 14:08:46 - SimpleLog - INFO: - episode: 886, ep_reward: -33.62005731015442, ep_step: 13 2023-05-26 14:08:46 - SimpleLog - INFO: - episode: 887, ep_reward: -13.464661097075759, ep_step: 14 2023-05-26 14:08:46 - SimpleLog - INFO: - episode: 888, ep_reward: -54.00978221525099, ep_step: 29 2023-05-26 14:08:46 - SimpleLog - INFO: - episode: 889, ep_reward: -90.18504505538796, ep_step: 42 2023-05-26 14:08:47 - SimpleLog - INFO: - episode: 890, ep_reward: -70.34713984241077, ep_step: 37 2023-05-26 14:08:49 - SimpleLog - INFO: - episode: 891, ep_reward: -1662.4762828113385, ep_step: 1000 2023-05-26 14:08:49 - SimpleLog - INFO: - episode: 892, ep_reward: -45.41730221900182, ep_step: 29 2023-05-26 14:08:49 - SimpleLog - INFO: - episode: 893, ep_reward: -31.40380527380353, ep_step: 20 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 894, ep_reward: -6.617174388135163, ep_step: 27 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 895, ep_reward: -23.821894190430587, ep_step: 11 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 896, ep_reward: -17.119659639733538, ep_step: 12 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 897, ep_reward: -16.655206734846765, ep_step: 11 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 898, ep_reward: -34.53744470222126, ep_step: 40 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 899, ep_reward: -26.9718400350921, ep_step: 17 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 900, ep_reward: -106.62913351670137, ep_step: 70 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 901, ep_reward: -71.86586009463639, ep_step: 58 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 902, ep_reward: -63.658508669673196, ep_step: 32 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 903, ep_reward: -64.47364134461563, ep_step: 43 2023-05-26 14:08:50 - SimpleLog - INFO: - episode: 904, ep_reward: -29.30796455110949, ep_step: 19 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 905, ep_reward: -72.53804437395132, ep_step: 37 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 906, ep_reward: -51.81834512477274, ep_step: 33 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 907, ep_reward: -126.20547675043319, ep_step: 84 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 908, ep_reward: -13.434872003043157, ep_step: 12 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 909, ep_reward: -35.5820782880822, ep_step: 18 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 910, ep_reward: -198.27239819880194, ep_step: 115 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 911, ep_reward: -23.977230880837606, ep_step: 14 2023-05-26 14:08:51 - SimpleLog - INFO: - episode: 912, ep_reward: -60.19357513061804, ep_step: 31 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 913, ep_reward: -19.680203135071736, ep_step: 13 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 914, ep_reward: -31.989500055451966, ep_step: 18 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 915, ep_reward: -208.65969051649486, ep_step: 85 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 916, ep_reward: -11.724833802505994, ep_step: 17 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 917, ep_reward: -32.68447559411712, ep_step: 29 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 918, ep_reward: -36.51799045781378, ep_step: 20 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 919, ep_reward: -37.086520055660515, ep_step: 25 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 920, ep_reward: -51.90311579831425, ep_step: 28 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 921, ep_reward: -74.1136915569524, ep_step: 45 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 922, ep_reward: -78.9589830692572, ep_step: 47 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 923, ep_reward: -11.120718900324077, ep_step: 12 2023-05-26 14:08:52 - SimpleLog - INFO: - episode: 924, ep_reward: -29.50119562483352, ep_step: 26 2023-05-26 14:08:53 - SimpleLog - INFO: - episode: 925, ep_reward: -29.5291271752078, ep_step: 13 2023-05-26 14:08:53 - SimpleLog - INFO: - episode: 926, ep_reward: -81.12381819676472, ep_step: 49 2023-05-26 14:08:53 - SimpleLog - INFO: - episode: 927, ep_reward: -27.861562089235463, ep_step: 16 2023-05-26 14:08:53 - SimpleLog - INFO: - episode: 928, ep_reward: -33.27869892765956, ep_step: 27 2023-05-26 14:08:56 - SimpleLog - INFO: - episode: 929, ep_reward: -1591.347369412969, ep_step: 1000 2023-05-26 14:08:58 - SimpleLog - INFO: - episode: 930, ep_reward: -1647.5362791539048, ep_step: 1000 2023-05-26 14:08:59 - SimpleLog - INFO: - episode: 931, ep_reward: -67.31612983524107, ep_step: 49 2023-05-26 14:08:59 - SimpleLog - INFO: - episode: 932, ep_reward: -124.74081862335677, ep_step: 66 2023-05-26 14:08:59 - SimpleLog - INFO: - episode: 933, ep_reward: -54.9022403238438, ep_step: 41 2023-05-26 14:08:59 - SimpleLog - INFO: - episode: 934, ep_reward: -42.488321037720176, ep_step: 25 2023-05-26 14:08:59 - SimpleLog - INFO: - episode: 935, ep_reward: -68.13245733260413, ep_step: 34 2023-05-26 14:08:59 - SimpleLog - INFO: - episode: 936, ep_reward: -167.8601500578934, ep_step: 52 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 937, ep_reward: -126.80741535243133, ep_step: 79 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 938, ep_reward: -26.29673417075782, ep_step: 19 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 939, ep_reward: -50.92806238064138, ep_step: 47 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 940, ep_reward: -18.73527596408152, ep_step: 10 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 941, ep_reward: -58.90596418717931, ep_step: 23 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 942, ep_reward: -35.451223406335416, ep_step: 24 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 943, ep_reward: -19.473108088721045, ep_step: 19 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 944, ep_reward: -12.140811288307708, ep_step: 12 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 945, ep_reward: -108.97414540687116, ep_step: 60 2023-05-26 14:09:00 - SimpleLog - INFO: - episode: 946, ep_reward: -25.11650989675065, ep_step: 14 2023-05-26 14:09:03 - SimpleLog - INFO: - episode: 947, ep_reward: -1703.7586676000194, ep_step: 1000 2023-05-26 14:09:03 - SimpleLog - INFO: - episode: 948, ep_reward: -33.73379913657062, ep_step: 17 2023-05-26 14:09:03 - SimpleLog - INFO: - episode: 949, ep_reward: -25.74154717461816, ep_step: 28 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 950, ep_reward: -20.783809750400557, ep_step: 18 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 951, ep_reward: -20.30539294340195, ep_step: 22 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 952, ep_reward: -27.19535278655737, ep_step: 14 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 953, ep_reward: -38.301258613731726, ep_step: 22 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 954, ep_reward: -18.426564665502283, ep_step: 20 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 955, ep_reward: -137.18979325915802, ep_step: 57 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 956, ep_reward: -40.94079760958534, ep_step: 40 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 957, ep_reward: -10.829185686367246, ep_step: 17 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 958, ep_reward: -30.36527331379401, ep_step: 14 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 959, ep_reward: -60.32929046768844, ep_step: 44 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 960, ep_reward: -33.34753890683495, ep_step: 20 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 961, ep_reward: -42.13433659546953, ep_step: 28 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 962, ep_reward: -75.12757990328147, ep_step: 31 2023-05-26 14:09:04 - SimpleLog - INFO: - episode: 963, ep_reward: 19.877126043994288, ep_step: 21 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 964, ep_reward: -109.57730674944077, ep_step: 44 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 965, ep_reward: -43.713958913564525, ep_step: 44 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 966, ep_reward: -21.633212640852406, ep_step: 27 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 967, ep_reward: -50.940608212614514, ep_step: 26 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 968, ep_reward: -19.99856870312184, ep_step: 22 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 969, ep_reward: -123.88659881679779, ep_step: 52 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 970, ep_reward: -25.945723902268185, ep_step: 18 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 971, ep_reward: -66.83587578607319, ep_step: 33 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 972, ep_reward: -40.396206508757054, ep_step: 34 2023-05-26 14:09:05 - SimpleLog - INFO: - episode: 973, ep_reward: -53.45745461645981, ep_step: 18 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 974, ep_reward: -12.122200847048244, ep_step: 15 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 975, ep_reward: -12.012682371633552, ep_step: 15 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 976, ep_reward: -204.791198135135, ep_step: 104 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 977, ep_reward: -61.43462309981698, ep_step: 30 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 978, ep_reward: -96.95696736673258, ep_step: 57 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 979, ep_reward: -102.8866360062048, ep_step: 48 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 980, ep_reward: -29.967736662100695, ep_step: 22 2023-05-26 14:09:06 - SimpleLog - INFO: - episode: 981, ep_reward: -48.214352015390084, ep_step: 21 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 982, ep_reward: -79.26773062567968, ep_step: 34 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 983, ep_reward: -71.18128738839278, ep_step: 62 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 984, ep_reward: -178.6769490366009, ep_step: 79 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 985, ep_reward: -37.62974204769741, ep_step: 23 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 986, ep_reward: -55.629071528967685, ep_step: 33 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 987, ep_reward: -10.848740798915053, ep_step: 11 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 988, ep_reward: -118.31332447667273, ep_step: 65 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 989, ep_reward: -31.881070001962534, ep_step: 16 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 990, ep_reward: -38.41276661778389, ep_step: 29 2023-05-26 14:09:07 - SimpleLog - INFO: - episode: 991, ep_reward: -28.677834689601696, ep_step: 15 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 992, ep_reward: -18.62921465016158, ep_step: 9 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 993, ep_reward: -39.14796117425797, ep_step: 27 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 994, ep_reward: -19.55335948036896, ep_step: 13 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 995, ep_reward: -19.799455918739937, ep_step: 12 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 996, ep_reward: -19.00740741658574, ep_step: 13 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 997, ep_reward: -23.90173199298793, ep_step: 24 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 998, ep_reward: -33.7507330756167, ep_step: 22 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 999, ep_reward: -174.6223457466531, ep_step: 80 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 1000, ep_reward: -38.997876177846116, ep_step: 17 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 1001, ep_reward: -56.821801091954576, ep_step: 40 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 1002, ep_reward: -29.96365064655768, ep_step: 15 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 1003, ep_reward: -68.90066494697054, ep_step: 46 2023-05-26 14:09:08 - SimpleLog - INFO: - episode: 1004, ep_reward: -39.3443372988371, ep_step: 32 2023-05-26 14:09:09 - SimpleLog - INFO: - episode: 1005, ep_reward: -13.839013343774928, ep_step: 12 2023-05-26 14:09:09 - SimpleLog - INFO: - episode: 1006, ep_reward: -27.17096989958179, ep_step: 18 2023-05-26 14:09:09 - SimpleLog - INFO: - episode: 1007, ep_reward: -55.14081822737846, ep_step: 24 2023-05-26 14:09:09 - SimpleLog - INFO: - episode: 1008, ep_reward: -23.00673622081794, ep_step: 17 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1009, ep_reward: -1718.0123995390347, ep_step: 1000 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1010, ep_reward: -113.46188924170073, ep_step: 59 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1011, ep_reward: -18.337382270071434, ep_step: 16 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1012, ep_reward: -27.94685978394428, ep_step: 19 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1013, ep_reward: -12.024144047403016, ep_step: 10 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1014, ep_reward: -13.781884026773785, ep_step: 28 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1015, ep_reward: -15.423315639394257, ep_step: 15 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1016, ep_reward: -9.372927237076526, ep_step: 11 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1017, ep_reward: -14.561210199119195, ep_step: 11 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1018, ep_reward: -6.050468348785653, ep_step: 17 2023-05-26 14:09:12 - SimpleLog - INFO: - episode: 1019, ep_reward: -34.39042277913101, ep_step: 21 2023-05-26 14:09:15 - SimpleLog - INFO: - episode: 1020, ep_reward: -1685.3529966673223, ep_step: 1000 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1021, ep_reward: -34.655220002331085, ep_step: 29 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1022, ep_reward: -32.0426683360916, ep_step: 16 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1023, ep_reward: -94.02295544568894, ep_step: 55 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1024, ep_reward: -11.778716951646405, ep_step: 12 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1025, ep_reward: -56.10694424799115, ep_step: 34 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1026, ep_reward: -113.1157622442238, ep_step: 112 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1027, ep_reward: -27.477185290910917, ep_step: 18 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1028, ep_reward: -7.622860255727087, ep_step: 11 2023-05-26 14:09:16 - SimpleLog - INFO: - episode: 1029, ep_reward: -17.974433667957612, ep_step: 12 2023-05-26 14:09:17 - SimpleLog - INFO: - episode: 1030, ep_reward: -102.20188721751751, ep_step: 55 2023-05-26 14:09:17 - SimpleLog - INFO: - episode: 1031, ep_reward: -27.163992606997905, ep_step: 14 2023-05-26 14:09:17 - SimpleLog - INFO: - episode: 1032, ep_reward: -22.037127026112955, ep_step: 14 2023-05-26 14:09:17 - SimpleLog - INFO: - episode: 1033, ep_reward: -24.81414252261709, ep_step: 12 2023-05-26 14:09:17 - SimpleLog - INFO: - episode: 1034, ep_reward: -16.26057382496748, ep_step: 11 2023-05-26 14:09:17 - SimpleLog - INFO: - episode: 1035, ep_reward: -51.45814364656445, ep_step: 36 2023-05-26 14:09:19 - SimpleLog - INFO: - episode: 1036, ep_reward: -1268.9999867036074, ep_step: 770 2023-05-26 14:09:19 - SimpleLog - INFO: - episode: 1037, ep_reward: -71.84281761335046, ep_step: 53 2023-05-26 14:09:19 - SimpleLog - INFO: - episode: 1038, ep_reward: -12.527563112696612, ep_step: 13 2023-05-26 14:09:20 - SimpleLog - INFO: - episode: 1039, ep_reward: -50.529717579305036, ep_step: 38 2023-05-26 14:09:20 - SimpleLog - INFO: - episode: 1040, ep_reward: -133.30979948701145, ep_step: 98 2023-05-26 14:09:20 - SimpleLog - INFO: - episode: 1041, ep_reward: -20.791047674947094, ep_step: 14 2023-05-26 14:09:20 - SimpleLog - INFO: - episode: 1042, ep_reward: -15.04331958385717, ep_step: 16 2023-05-26 14:09:20 - SimpleLog - INFO: - episode: 1043, ep_reward: -29.397315758853367, ep_step: 34 2023-05-26 14:09:20 - SimpleLog - INFO: - episode: 1044, ep_reward: -72.52087018983937, ep_step: 33 2023-05-26 14:09:20 - SimpleLog - INFO: - episode: 1045, ep_reward: -17.925087071026912, ep_step: 19 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1046, ep_reward: -142.4850858943913, ep_step: 72 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1047, ep_reward: -37.78010427695941, ep_step: 21 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1048, ep_reward: -11.380568248003236, ep_step: 12 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1049, ep_reward: -17.912532759510153, ep_step: 12 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1050, ep_reward: -15.766947373626781, ep_step: 12 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1051, ep_reward: -46.12262448070491, ep_step: 27 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1052, ep_reward: -49.55631366490425, ep_step: 31 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1053, ep_reward: -21.07283039982068, ep_step: 12 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1054, ep_reward: -31.064164129486002, ep_step: 61 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1055, ep_reward: -8.604507159020336, ep_step: 11 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1056, ep_reward: -40.21092494473471, ep_step: 23 2023-05-26 14:09:21 - SimpleLog - INFO: - episode: 1057, ep_reward: -38.5204291990738, ep_step: 45 2023-05-26 14:09:24 - SimpleLog - INFO: - episode: 1058, ep_reward: -1647.871001312292, ep_step: 1000 2023-05-26 14:09:24 - SimpleLog - INFO: - episode: 1059, ep_reward: -147.6811727179491, ep_step: 69 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1060, ep_reward: -18.07756903933647, ep_step: 25 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1061, ep_reward: -26.23737698660232, ep_step: 15 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1062, ep_reward: -26.561499642554466, ep_step: 16 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1063, ep_reward: -32.27773218544608, ep_step: 14 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1064, ep_reward: -54.39392669545346, ep_step: 44 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1065, ep_reward: -52.329944988034825, ep_step: 29 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1066, ep_reward: -8.821927849157655, ep_step: 12 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1067, ep_reward: -100.55520112286254, ep_step: 59 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1068, ep_reward: -35.69919747654127, ep_step: 17 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1069, ep_reward: -26.368209953918097, ep_step: 12 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1070, ep_reward: -32.23718299164399, ep_step: 16 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1071, ep_reward: -29.54792173310431, ep_step: 16 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1072, ep_reward: -28.73424735323707, ep_step: 19 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1073, ep_reward: -47.266868058986866, ep_step: 23 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1074, ep_reward: -41.691509044235154, ep_step: 31 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1075, ep_reward: -12.558528252287257, ep_step: 32 2023-05-26 14:09:25 - SimpleLog - INFO: - episode: 1076, ep_reward: -4.991209274092181, ep_step: 12 2023-05-26 14:09:26 - SimpleLog - INFO: - episode: 1077, ep_reward: -108.18170373400542, ep_step: 45 2023-05-26 14:09:26 - SimpleLog - INFO: - episode: 1078, ep_reward: -263.8462177970381, ep_step: 116 2023-05-26 14:09:29 - SimpleLog - INFO: - episode: 1079, ep_reward: -1798.6998295853443, ep_step: 1000 2023-05-26 14:09:29 - SimpleLog - INFO: - episode: 1080, ep_reward: -24.474317744376037, ep_step: 32 2023-05-26 14:09:29 - SimpleLog - INFO: - episode: 1081, ep_reward: -76.75826356378126, ep_step: 51 2023-05-26 14:09:29 - SimpleLog - INFO: - episode: 1082, ep_reward: -44.024856208085524, ep_step: 20 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1083, ep_reward: -119.25753980511, ep_step: 58 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1084, ep_reward: -34.98580783235858, ep_step: 29 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1085, ep_reward: -24.744296800824618, ep_step: 12 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1086, ep_reward: -32.203324695670304, ep_step: 20 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1087, ep_reward: -19.592052543086304, ep_step: 26 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1088, ep_reward: -30.76588577149101, ep_step: 18 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1089, ep_reward: -33.41166484622932, ep_step: 17 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1090, ep_reward: -71.0428780214442, ep_step: 49 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1091, ep_reward: -19.36069086873303, ep_step: 18 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1092, ep_reward: -61.08113226294808, ep_step: 31 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1093, ep_reward: -67.39769668356911, ep_step: 40 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1094, ep_reward: -21.533491871516336, ep_step: 13 2023-05-26 14:09:30 - SimpleLog - INFO: - episode: 1095, ep_reward: -18.703539636391596, ep_step: 20 2023-05-26 14:09:31 - SimpleLog - INFO: - episode: 1096, ep_reward: -21.151930987847482, ep_step: 22 2023-05-26 14:09:31 - SimpleLog - INFO: - episode: 1097, ep_reward: -13.364515992045732, ep_step: 18 2023-05-26 14:09:33 - SimpleLog - INFO: - episode: 1098, ep_reward: -1731.5236751446082, ep_step: 1000 2023-05-26 14:09:33 - SimpleLog - INFO: - episode: 1099, ep_reward: -32.242417261267086, ep_step: 21 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1100, ep_reward: -18.254245952216483, ep_step: 11 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1101, ep_reward: -120.49517997702631, ep_step: 55 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1102, ep_reward: -32.78853739508857, ep_step: 20 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1103, ep_reward: -61.016849068535194, ep_step: 36 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1104, ep_reward: -40.55115889295394, ep_step: 43 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1105, ep_reward: -21.550119160787204, ep_step: 14 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1106, ep_reward: -121.48071695613427, ep_step: 51 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1107, ep_reward: -22.421741613120396, ep_step: 13 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1108, ep_reward: -18.352946248733822, ep_step: 12 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1109, ep_reward: -17.495166217147336, ep_step: 22 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1110, ep_reward: -16.759321784146312, ep_step: 16 2023-05-26 14:09:34 - SimpleLog - INFO: - episode: 1111, ep_reward: -157.2681888082739, ep_step: 70 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1112, ep_reward: -45.59105173532235, ep_step: 48 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1113, ep_reward: -39.8652566172539, ep_step: 57 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1114, ep_reward: -47.797890299549806, ep_step: 27 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1115, ep_reward: -50.60094799794444, ep_step: 25 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1116, ep_reward: -50.58801594350322, ep_step: 30 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1117, ep_reward: -13.202956195821223, ep_step: 12 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1118, ep_reward: -104.62553958072799, ep_step: 60 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1119, ep_reward: -52.209454852240825, ep_step: 26 2023-05-26 14:09:35 - SimpleLog - INFO: - episode: 1120, ep_reward: -45.780138366848256, ep_step: 23 2023-05-26 14:09:36 - SimpleLog - INFO: - episode: 1121, ep_reward: -110.77410750606393, ep_step: 70 2023-05-26 14:09:36 - SimpleLog - INFO: - episode: 1122, ep_reward: -63.04587963626252, ep_step: 37 2023-05-26 14:09:36 - SimpleLog - INFO: - episode: 1123, ep_reward: -46.380303161944596, ep_step: 21 2023-05-26 14:09:36 - SimpleLog - INFO: - episode: 1124, ep_reward: -147.47334994414803, ep_step: 72 2023-05-26 14:09:36 - SimpleLog - INFO: - episode: 1125, ep_reward: -48.42017636969766, ep_step: 30 2023-05-26 14:09:36 - SimpleLog - INFO: - episode: 1126, ep_reward: -118.72124478792794, ep_step: 54 2023-05-26 14:09:39 - SimpleLog - INFO: - episode: 1127, ep_reward: -1601.7082500516046, ep_step: 903 2023-05-26 14:09:39 - SimpleLog - INFO: - episode: 1128, ep_reward: -34.917647657445265, ep_step: 33 2023-05-26 14:09:39 - SimpleLog - INFO: - episode: 1129, ep_reward: -105.01659219289358, ep_step: 44 2023-05-26 14:09:40 - SimpleLog - INFO: - episode: 1130, ep_reward: -57.25282597802829, ep_step: 33 2023-05-26 14:09:40 - SimpleLog - INFO: - episode: 1131, ep_reward: -42.43080750810918, ep_step: 33 2023-05-26 14:09:40 - SimpleLog - INFO: - episode: 1132, ep_reward: -8.859868702885086, ep_step: 14 2023-05-26 14:09:40 - SimpleLog - INFO: - episode: 1133, ep_reward: -91.14005949800989, ep_step: 42 2023-05-26 14:09:43 - SimpleLog - INFO: - episode: 1134, ep_reward: -1789.1251012597056, ep_step: 1000 2023-05-26 14:09:43 - SimpleLog - INFO: - episode: 1135, ep_reward: -128.94683779361776, ep_step: 60 2023-05-26 14:09:43 - SimpleLog - INFO: - episode: 1136, ep_reward: -44.85124225051974, ep_step: 19 2023-05-26 14:09:43 - SimpleLog - INFO: - episode: 1137, ep_reward: -46.29442214165234, ep_step: 23 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1138, ep_reward: -408.95088543494876, ep_step: 241 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1139, ep_reward: -29.307228444954358, ep_step: 17 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1140, ep_reward: -15.697980474197012, ep_step: 35 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1141, ep_reward: -36.20338041028085, ep_step: 20 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1142, ep_reward: -56.497997096274084, ep_step: 32 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1143, ep_reward: -34.603621378593516, ep_step: 15 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1144, ep_reward: -36.980102490548894, ep_step: 30 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1145, ep_reward: -37.67233308174242, ep_step: 39 2023-05-26 14:09:44 - SimpleLog - INFO: - episode: 1146, ep_reward: -66.954812456285, ep_step: 27 2023-05-26 14:09:45 - SimpleLog - INFO: - episode: 1147, ep_reward: -166.16091457075458, ep_step: 71 2023-05-26 14:09:45 - SimpleLog - INFO: - episode: 1148, ep_reward: -53.85030225260047, ep_step: 51 2023-05-26 14:09:45 - SimpleLog - INFO: - episode: 1149, ep_reward: -15.223586949554285, ep_step: 17 2023-05-26 14:09:45 - SimpleLog - INFO: - episode: 1150, ep_reward: -94.45721028473969, ep_step: 64 2023-05-26 14:09:45 - SimpleLog - INFO: - episode: 1151, ep_reward: -25.100053860052846, ep_step: 17 2023-05-26 14:09:45 - SimpleLog - INFO: - episode: 1152, ep_reward: -42.446832439331516, ep_step: 34 2023-05-26 14:09:45 - SimpleLog - INFO: - episode: 1153, ep_reward: -75.66224828884788, ep_step: 48 2023-05-26 14:09:46 - SimpleLog - INFO: - episode: 1154, ep_reward: -176.82610591335464, ep_step: 77 2023-05-26 14:09:46 - SimpleLog - INFO: - episode: 1155, ep_reward: -141.51455931706056, ep_step: 66 2023-05-26 14:09:46 - SimpleLog - INFO: - episode: 1156, ep_reward: -22.425806081212713, ep_step: 12 2023-05-26 14:09:46 - SimpleLog - INFO: - episode: 1157, ep_reward: -201.62733441332514, ep_step: 103 2023-05-26 14:09:46 - SimpleLog - INFO: - episode: 1158, ep_reward: -14.978526728075854, ep_step: 11 2023-05-26 14:09:46 - SimpleLog - INFO: - episode: 1159, ep_reward: -79.32847754746741, ep_step: 39 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1160, ep_reward: -107.71380746856612, ep_step: 47 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1161, ep_reward: -31.124371232383893, ep_step: 17 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1162, ep_reward: -18.157950396148415, ep_step: 12 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1163, ep_reward: -9.68572706969206, ep_step: 16 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1164, ep_reward: -44.443043835431524, ep_step: 22 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1165, ep_reward: -16.092092994759202, ep_step: 12 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1166, ep_reward: -57.220966251043265, ep_step: 27 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1167, ep_reward: -57.71881428841196, ep_step: 29 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1168, ep_reward: -63.067137161521266, ep_step: 39 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1169, ep_reward: -15.676720238103723, ep_step: 11 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1170, ep_reward: -48.16659883269273, ep_step: 30 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1171, ep_reward: -147.43378174772752, ep_step: 66 2023-05-26 14:09:47 - SimpleLog - INFO: - episode: 1172, ep_reward: -98.6406048183344, ep_step: 55 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1173, ep_reward: -85.14592520889235, ep_step: 36 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1174, ep_reward: -62.79030780534731, ep_step: 30 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1175, ep_reward: -24.10514698075313, ep_step: 13 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1176, ep_reward: 8.632675479343046, ep_step: 16 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1177, ep_reward: -28.9357467407272, ep_step: 12 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1178, ep_reward: -52.33573045418853, ep_step: 20 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1179, ep_reward: -13.975378814026199, ep_step: 11 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1180, ep_reward: -42.868876657661666, ep_step: 33 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1181, ep_reward: -51.161180149529876, ep_step: 36 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1182, ep_reward: -9.714933286716947, ep_step: 10 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1183, ep_reward: -21.370206701528975, ep_step: 16 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1184, ep_reward: -105.39565723509064, ep_step: 67 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1185, ep_reward: -34.45089662185447, ep_step: 23 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1186, ep_reward: -19.768398779243064, ep_step: 13 2023-05-26 14:09:48 - SimpleLog - INFO: - episode: 1187, ep_reward: -19.453738019061948, ep_step: 14 2023-05-26 14:09:49 - SimpleLog - INFO: - episode: 1188, ep_reward: -69.25188859728824, ep_step: 54 2023-05-26 14:09:49 - SimpleLog - INFO: - episode: 1189, ep_reward: -19.744258381735932, ep_step: 11 2023-05-26 14:09:49 - SimpleLog - INFO: - episode: 1190, ep_reward: -23.2274870560187, ep_step: 19 2023-05-26 14:09:49 - SimpleLog - INFO: - episode: 1191, ep_reward: -33.175210349382255, ep_step: 30 2023-05-26 14:09:49 - SimpleLog - INFO: - episode: 1192, ep_reward: -35.214179215830654, ep_step: 23 2023-05-26 14:09:49 - SimpleLog - INFO: - episode: 1193, ep_reward: -43.63061996098613, ep_step: 27 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1194, ep_reward: -1631.675950913612, ep_step: 1000 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1195, ep_reward: -47.739512024739504, ep_step: 39 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1196, ep_reward: -24.48414955037216, ep_step: 16 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1197, ep_reward: -11.543219616690575, ep_step: 10 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1198, ep_reward: -19.47969684143288, ep_step: 10 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1199, ep_reward: -8.913638819985003, ep_step: 9 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1200, ep_reward: -22.365073561505746, ep_step: 20 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1201, ep_reward: -40.92407321397877, ep_step: 34 2023-05-26 14:09:52 - SimpleLog - INFO: - episode: 1202, ep_reward: -12.21616968797191, ep_step: 15 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1203, ep_reward: -80.77755397140267, ep_step: 63 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1204, ep_reward: -10.83503938905378, ep_step: 11 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1205, ep_reward: -32.50528073750933, ep_step: 23 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1206, ep_reward: -14.014311530315402, ep_step: 17 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1207, ep_reward: -47.375068948290675, ep_step: 29 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1208, ep_reward: -10.909900296639327, ep_step: 21 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1209, ep_reward: -12.216644022419604, ep_step: 11 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1210, ep_reward: -24.585056699506005, ep_step: 17 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1211, ep_reward: -16.776070012087832, ep_step: 10 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1212, ep_reward: -32.59456243028153, ep_step: 31 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1213, ep_reward: -34.616553515830574, ep_step: 18 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1214, ep_reward: -11.331919140026963, ep_step: 10 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1215, ep_reward: -60.22652294444227, ep_step: 39 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1216, ep_reward: -22.970578494129004, ep_step: 25 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1217, ep_reward: -40.65595779031118, ep_step: 25 2023-05-26 14:09:53 - SimpleLog - INFO: - episode: 1218, ep_reward: -53.730421470748155, ep_step: 24 2023-05-26 14:09:54 - SimpleLog - INFO: - episode: 1219, ep_reward: -36.95627739501963, ep_step: 19 2023-05-26 14:09:54 - SimpleLog - INFO: - episode: 1220, ep_reward: 0.4589897671612677, ep_step: 22 2023-05-26 14:09:54 - SimpleLog - INFO: - episode: 1221, ep_reward: -18.006709695092816, ep_step: 13 2023-05-26 14:09:54 - SimpleLog - INFO: - episode: 1222, ep_reward: -263.7188946169398, ep_step: 163 2023-05-26 14:09:55 - SimpleLog - INFO: - episode: 1223, ep_reward: -547.9188206825553, ep_step: 327 2023-05-26 14:09:55 - SimpleLog - INFO: - episode: 1224, ep_reward: -15.152346644361158, ep_step: 10 2023-05-26 14:09:55 - SimpleLog - INFO: - episode: 1225, ep_reward: -17.332319419992164, ep_step: 21 2023-05-26 14:09:58 - SimpleLog - INFO: - episode: 1226, ep_reward: -1679.6688902218132, ep_step: 1000 2023-05-26 14:09:58 - SimpleLog - INFO: - episode: 1227, ep_reward: -28.034457600862268, ep_step: 27 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1228, ep_reward: -78.98377232752728, ep_step: 50 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1229, ep_reward: -25.983509454758018, ep_step: 20 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1230, ep_reward: -19.640852265534416, ep_step: 16 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1231, ep_reward: -23.426995765081855, ep_step: 15 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1232, ep_reward: -9.452618990776987, ep_step: 14 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1233, ep_reward: -22.711281771913775, ep_step: 20 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1234, ep_reward: -23.817494393028735, ep_step: 17 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1235, ep_reward: -236.0704464705523, ep_step: 101 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1236, ep_reward: -21.77623519155073, ep_step: 14 2023-05-26 14:09:59 - SimpleLog - INFO: - episode: 1237, ep_reward: -138.28053994825288, ep_step: 70 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1238, ep_reward: -21.992772913259333, ep_step: 19 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1239, ep_reward: -50.80766253224338, ep_step: 32 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1240, ep_reward: -37.391275991955226, ep_step: 25 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1241, ep_reward: -146.9144102883006, ep_step: 77 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1242, ep_reward: -22.42680741726785, ep_step: 15 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1243, ep_reward: -21.049016320073683, ep_step: 14 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1244, ep_reward: -12.239698762492688, ep_step: 13 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1245, ep_reward: -40.725332303590164, ep_step: 25 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1246, ep_reward: -61.130919432970124, ep_step: 56 2023-05-26 14:10:00 - SimpleLog - INFO: - episode: 1247, ep_reward: -19.779308147124453, ep_step: 13 2023-05-26 14:10:03 - SimpleLog - INFO: - episode: 1248, ep_reward: -1640.408153886378, ep_step: 1000 2023-05-26 14:10:03 - SimpleLog - INFO: - episode: 1249, ep_reward: -28.495746002389414, ep_step: 17 2023-05-26 14:10:03 - SimpleLog - INFO: - episode: 1250, ep_reward: -23.405546584207542, ep_step: 13 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1251, ep_reward: -207.94668023508171, ep_step: 111 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1252, ep_reward: -18.80321535754827, ep_step: 16 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1253, ep_reward: -48.93046638689509, ep_step: 32 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1254, ep_reward: -21.42931190398682, ep_step: 47 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1255, ep_reward: -64.32913536729053, ep_step: 44 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1256, ep_reward: -113.39383657820062, ep_step: 44 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1257, ep_reward: -18.383817031704126, ep_step: 9 2023-05-26 14:10:04 - SimpleLog - INFO: - episode: 1258, ep_reward: -119.7039106920562, ep_step: 66 2023-05-26 14:10:05 - SimpleLog - INFO: - episode: 1259, ep_reward: -48.68112546191447, ep_step: 39 2023-05-26 14:10:05 - SimpleLog - INFO: - episode: 1260, ep_reward: -55.70873402290507, ep_step: 38 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1261, ep_reward: -997.3861512747859, ep_step: 586 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1262, ep_reward: -44.20239915294027, ep_step: 23 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1263, ep_reward: -75.33972710717369, ep_step: 54 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1264, ep_reward: -16.97015511093859, ep_step: 11 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1265, ep_reward: -10.292875114903639, ep_step: 9 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1266, ep_reward: -18.82985453747333, ep_step: 11 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1267, ep_reward: -43.023664852494484, ep_step: 33 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1268, ep_reward: -137.43811705536632, ep_step: 84 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1269, ep_reward: -48.377079427317106, ep_step: 20 2023-05-26 14:10:07 - SimpleLog - INFO: - episode: 1270, ep_reward: -20.228257033325487, ep_step: 12 2023-05-26 14:10:10 - SimpleLog - INFO: - episode: 1271, ep_reward: -1635.4063737425474, ep_step: 1000 2023-05-26 14:10:10 - SimpleLog - INFO: - episode: 1272, ep_reward: -57.088675349106275, ep_step: 41 2023-05-26 14:10:10 - SimpleLog - INFO: - episode: 1273, ep_reward: -119.69504442525049, ep_step: 60 2023-05-26 14:10:10 - SimpleLog - INFO: - episode: 1274, ep_reward: -29.264674323525618, ep_step: 18 2023-05-26 14:10:10 - SimpleLog - INFO: - episode: 1275, ep_reward: 0.4708274083696673, ep_step: 22 2023-05-26 14:10:10 - SimpleLog - INFO: - episode: 1276, ep_reward: -59.78868003433759, ep_step: 21 2023-05-26 14:10:11 - SimpleLog - INFO: - episode: 1277, ep_reward: -36.47168694640142, ep_step: 25 2023-05-26 14:10:11 - SimpleLog - INFO: - episode: 1278, ep_reward: -60.84489896847352, ep_step: 21 2023-05-26 14:10:11 - SimpleLog - INFO: - episode: 1279, ep_reward: -46.63872069228317, ep_step: 39 2023-05-26 14:10:11 - SimpleLog - INFO: - episode: 1280, ep_reward: -6.696670163819227, ep_step: 12 2023-05-26 14:10:11 - SimpleLog - INFO: - episode: 1281, ep_reward: -12.456492372028626, ep_step: 18 2023-05-26 14:10:11 - SimpleLog - INFO: - episode: 1282, ep_reward: -45.577613765473366, ep_step: 31 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1283, ep_reward: -1742.968850778085, ep_step: 1000 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1284, ep_reward: -38.330959046252296, ep_step: 22 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1285, ep_reward: -49.67823694347374, ep_step: 32 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1286, ep_reward: -25.141237533982075, ep_step: 12 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1287, ep_reward: -67.95522514343136, ep_step: 44 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1288, ep_reward: -21.298854657007183, ep_step: 12 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1289, ep_reward: -52.40183930810394, ep_step: 23 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1290, ep_reward: -33.171628080606595, ep_step: 25 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1291, ep_reward: -34.16088688641001, ep_step: 23 2023-05-26 14:10:14 - SimpleLog - INFO: - episode: 1292, ep_reward: -19.956070043935668, ep_step: 16 2023-05-26 14:10:15 - SimpleLog - INFO: - episode: 1293, ep_reward: -73.65505569032973, ep_step: 48 2023-05-26 14:10:15 - SimpleLog - INFO: - episode: 1294, ep_reward: -17.620980037583628, ep_step: 15 2023-05-26 14:10:15 - SimpleLog - INFO: - episode: 1295, ep_reward: -81.0208640733268, ep_step: 34 2023-05-26 14:10:15 - SimpleLog - INFO: - episode: 1296, ep_reward: -9.466215529916319, ep_step: 19 2023-05-26 14:10:15 - SimpleLog - INFO: - episode: 1297, ep_reward: -58.517158430542715, ep_step: 27 2023-05-26 14:10:15 - SimpleLog - INFO: - episode: 1298, ep_reward: -17.04533434944902, ep_step: 23 2023-05-26 14:10:15 - SimpleLog - INFO: - episode: 1299, ep_reward: -23.00532809259021, ep_step: 13 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1300, ep_reward: -1502.9831410454917, ep_step: 882 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1301, ep_reward: -26.24698202644494, ep_step: 17 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1302, ep_reward: -45.723174963567594, ep_step: 31 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1303, ep_reward: -15.62595193844247, ep_step: 9 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1304, ep_reward: -22.30238096606505, ep_step: 10 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1305, ep_reward: -17.378126371167383, ep_step: 15 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1306, ep_reward: -30.021431598624375, ep_step: 16 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1307, ep_reward: -21.36531301512267, ep_step: 18 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1308, ep_reward: -47.28437080706868, ep_step: 24 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1309, ep_reward: -44.01574685960702, ep_step: 32 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1310, ep_reward: -25.65248368287566, ep_step: 17 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1311, ep_reward: -86.24190183620644, ep_step: 46 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1312, ep_reward: -15.44519109277246, ep_step: 13 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1313, ep_reward: -45.62720729081724, ep_step: 30 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1314, ep_reward: -40.76024911687478, ep_step: 35 2023-05-26 14:10:18 - SimpleLog - INFO: - episode: 1315, ep_reward: -82.77777370587961, ep_step: 36 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1316, ep_reward: -137.306960299429, ep_step: 78 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1317, ep_reward: -74.3765448471003, ep_step: 45 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1318, ep_reward: -10.52508079230075, ep_step: 11 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1319, ep_reward: -131.31691027216394, ep_step: 80 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1320, ep_reward: -46.47648108989036, ep_step: 19 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1321, ep_reward: -32.206160947177004, ep_step: 18 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1322, ep_reward: -78.45771678291725, ep_step: 42 2023-05-26 14:10:19 - SimpleLog - INFO: - episode: 1323, ep_reward: -39.38106823403945, ep_step: 22 2023-05-26 14:10:22 - SimpleLog - INFO: - episode: 1324, ep_reward: -1708.793798568519, ep_step: 1000 2023-05-26 14:10:22 - SimpleLog - INFO: - episode: 1325, ep_reward: -84.76311417674602, ep_step: 30 2023-05-26 14:10:22 - SimpleLog - INFO: - episode: 1326, ep_reward: -59.16080805466476, ep_step: 39 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1327, ep_reward: -111.17081291619425, ep_step: 51 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1328, ep_reward: -52.897457566152646, ep_step: 50 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1329, ep_reward: -19.478718598820343, ep_step: 13 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1330, ep_reward: -33.50542708118559, ep_step: 29 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1331, ep_reward: -17.031489221169927, ep_step: 15 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1332, ep_reward: -11.856208672044843, ep_step: 12 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1333, ep_reward: -17.848757038561605, ep_step: 16 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1334, ep_reward: -42.18375614273245, ep_step: 18 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1335, ep_reward: -38.47092692481112, ep_step: 30 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1336, ep_reward: -46.37638881563745, ep_step: 37 2023-05-26 14:10:23 - SimpleLog - INFO: - episode: 1337, ep_reward: -9.359564162200286, ep_step: 14 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1338, ep_reward: -90.12571908869903, ep_step: 62 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1339, ep_reward: -48.253296395336264, ep_step: 32 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1340, ep_reward: -19.085078554289918, ep_step: 12 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1341, ep_reward: -147.07611019243495, ep_step: 74 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1342, ep_reward: -39.523029353629965, ep_step: 19 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1343, ep_reward: -11.209686924352493, ep_step: 17 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1344, ep_reward: -40.57816676006884, ep_step: 24 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1345, ep_reward: -14.454890925961376, ep_step: 11 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1346, ep_reward: -22.972097940595287, ep_step: 17 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1347, ep_reward: -85.9991623475771, ep_step: 36 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1348, ep_reward: -5.228479514243367, ep_step: 13 2023-05-26 14:10:24 - SimpleLog - INFO: - episode: 1349, ep_reward: -27.735521101843506, ep_step: 23 2023-05-26 14:10:25 - SimpleLog - INFO: - episode: 1350, ep_reward: -33.16780960576778, ep_step: 21 2023-05-26 14:10:25 - SimpleLog - INFO: - episode: 1351, ep_reward: -12.995712978347889, ep_step: 11 2023-05-26 14:10:25 - SimpleLog - INFO: - episode: 1352, ep_reward: -17.73548848980245, ep_step: 16 2023-05-26 14:10:27 - SimpleLog - INFO: - episode: 1353, ep_reward: -1404.4105964114926, ep_step: 850 2023-05-26 14:10:27 - SimpleLog - INFO: - episode: 1354, ep_reward: -25.500346317441174, ep_step: 15 2023-05-26 14:10:28 - SimpleLog - INFO: - episode: 1355, ep_reward: -55.46536002572215, ep_step: 47 2023-05-26 14:10:28 - SimpleLog - INFO: - episode: 1356, ep_reward: -10.111840340558537, ep_step: 11 2023-05-26 14:10:28 - SimpleLog - INFO: - episode: 1357, ep_reward: -9.128143327759279, ep_step: 8 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1358, ep_reward: -631.0518525014556, ep_step: 413 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1359, ep_reward: -137.88052965709178, ep_step: 71 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1360, ep_reward: -7.819008982522806, ep_step: 9 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1361, ep_reward: -22.151551918415137, ep_step: 10 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1362, ep_reward: -128.7901345287908, ep_step: 66 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1363, ep_reward: -29.957518181403504, ep_step: 39 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1364, ep_reward: -22.35986953573755, ep_step: 23 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1365, ep_reward: -2.521508060012522, ep_step: 13 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1366, ep_reward: -20.171312944622787, ep_step: 22 2023-05-26 14:10:29 - SimpleLog - INFO: - episode: 1367, ep_reward: -55.263415726198595, ep_step: 28 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1368, ep_reward: -32.645744695413754, ep_step: 17 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1369, ep_reward: -104.89287341961511, ep_step: 65 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1370, ep_reward: -144.2811620486661, ep_step: 67 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1371, ep_reward: -52.6773903734741, ep_step: 28 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1372, ep_reward: -53.31076498831882, ep_step: 26 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1373, ep_reward: -27.42049622107848, ep_step: 23 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1374, ep_reward: -50.3184169612974, ep_step: 25 2023-05-26 14:10:30 - SimpleLog - INFO: - episode: 1375, ep_reward: -60.36584854745739, ep_step: 30 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1376, ep_reward: -47.453091817338716, ep_step: 24 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1377, ep_reward: -6.492914332330686, ep_step: 16 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1378, ep_reward: -35.84433741757332, ep_step: 26 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1379, ep_reward: -54.302205009293466, ep_step: 21 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1380, ep_reward: -84.95134366800569, ep_step: 66 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1381, ep_reward: -25.23892696535009, ep_step: 16 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1382, ep_reward: -16.323281629293295, ep_step: 13 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1383, ep_reward: -47.70136030878152, ep_step: 19 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1384, ep_reward: -73.63572644165009, ep_step: 36 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1385, ep_reward: -92.47136484555382, ep_step: 46 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1386, ep_reward: -25.64030178148369, ep_step: 16 2023-05-26 14:10:31 - SimpleLog - INFO: - episode: 1387, ep_reward: -36.15213946416958, ep_step: 14 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1388, ep_reward: -122.47311067388564, ep_step: 60 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1389, ep_reward: -26.213524253954407, ep_step: 18 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1390, ep_reward: -20.130268815436434, ep_step: 12 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1391, ep_reward: -14.977695654768981, ep_step: 13 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1392, ep_reward: -27.816318075255264, ep_step: 25 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1393, ep_reward: -23.44901729431502, ep_step: 12 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1394, ep_reward: -19.09139174264946, ep_step: 13 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1395, ep_reward: -33.50841289764749, ep_step: 24 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1396, ep_reward: -65.10066922304293, ep_step: 37 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1397, ep_reward: -27.15399089928798, ep_step: 23 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1398, ep_reward: -25.619120848565924, ep_step: 14 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1399, ep_reward: -21.27134033923728, ep_step: 14 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1400, ep_reward: -6.9389720462747535, ep_step: 11 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1401, ep_reward: -19.217602945350997, ep_step: 12 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1402, ep_reward: -24.473775277342213, ep_step: 16 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1403, ep_reward: -101.30132566702171, ep_step: 51 2023-05-26 14:10:32 - SimpleLog - INFO: - episode: 1404, ep_reward: -48.887780402176475, ep_step: 21 2023-05-26 14:10:33 - SimpleLog - INFO: - episode: 1405, ep_reward: -18.28441298272162, ep_step: 22 2023-05-26 14:10:33 - SimpleLog - INFO: - episode: 1406, ep_reward: -79.79916617516993, ep_step: 51 2023-05-26 14:10:33 - SimpleLog - INFO: - episode: 1407, ep_reward: -187.34991310404175, ep_step: 115 2023-05-26 14:10:33 - SimpleLog - INFO: - episode: 1408, ep_reward: -38.70095832151971, ep_step: 25 2023-05-26 14:10:33 - SimpleLog - INFO: - episode: 1409, ep_reward: -10.7685228110389, ep_step: 13 2023-05-26 14:10:33 - SimpleLog - INFO: - episode: 1410, ep_reward: -87.38382373407265, ep_step: 59 2023-05-26 14:10:33 - SimpleLog - INFO: - episode: 1411, ep_reward: -36.59887156219329, ep_step: 30 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1412, ep_reward: -29.967580492953342, ep_step: 44 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1413, ep_reward: -117.46789161068017, ep_step: 46 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1414, ep_reward: -16.99499322579804, ep_step: 11 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1415, ep_reward: -10.872003571333394, ep_step: 10 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1416, ep_reward: -47.88035587107872, ep_step: 28 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1417, ep_reward: -52.899579454721135, ep_step: 34 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1418, ep_reward: -74.66059083607266, ep_step: 28 2023-05-26 14:10:34 - SimpleLog - INFO: - episode: 1419, ep_reward: -50.023380622934944, ep_step: 33 2023-05-26 14:10:37 - SimpleLog - INFO: - episode: 1420, ep_reward: -1768.9636389392806, ep_step: 1000 2023-05-26 14:10:37 - SimpleLog - INFO: - episode: 1421, ep_reward: -10.29000004479391, ep_step: 20 2023-05-26 14:10:37 - SimpleLog - INFO: - episode: 1422, ep_reward: -60.24042362228097, ep_step: 34 2023-05-26 14:10:37 - SimpleLog - INFO: - episode: 1423, ep_reward: -25.47804425455183, ep_step: 16 2023-05-26 14:10:38 - SimpleLog - INFO: - episode: 1424, ep_reward: -47.08394797277663, ep_step: 27 2023-05-26 14:10:38 - SimpleLog - INFO: - episode: 1425, ep_reward: -24.94105644723101, ep_step: 14 2023-05-26 14:10:38 - SimpleLog - INFO: - episode: 1426, ep_reward: -21.618595404085287, ep_step: 11 2023-05-26 14:10:41 - SimpleLog - INFO: - update_step: 500, online_eval_reward: -19.466 2023-05-26 14:10:41 - SimpleLog - INFO: - current update step obtain a better online_eval_reward: -19.466, save the best model! 2023-05-26 14:10:41 - SimpleLog - INFO: - episode: 1427, ep_reward: -1768.8107969160146, ep_step: 1000 2023-05-26 14:10:41 - SimpleLog - INFO: - episode: 1428, ep_reward: -28.574211046436083, ep_step: 32 2023-05-26 14:10:41 - SimpleLog - INFO: - episode: 1429, ep_reward: -27.651517998774963, ep_step: 42 2023-05-26 14:10:41 - SimpleLog - INFO: - episode: 1430, ep_reward: -60.46747920798444, ep_step: 29 2023-05-26 14:10:41 - SimpleLog - INFO: - episode: 1431, ep_reward: -12.397084568581858, ep_step: 10 2023-05-26 14:10:41 - SimpleLog - INFO: - episode: 1432, ep_reward: -54.84908692745448, ep_step: 44 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1433, ep_reward: -1587.0452209994246, ep_step: 873 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1434, ep_reward: -24.304599359709503, ep_step: 29 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1435, ep_reward: -9.731893118894025, ep_step: 14 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1436, ep_reward: -13.773337807181314, ep_step: 9 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1437, ep_reward: -29.278980075430006, ep_step: 18 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1438, ep_reward: -37.82635345184998, ep_step: 26 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1439, ep_reward: -42.01506953174234, ep_step: 17 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1440, ep_reward: -11.388836383400367, ep_step: 9 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1441, ep_reward: -82.54355921981956, ep_step: 69 2023-05-26 14:10:44 - SimpleLog - INFO: - episode: 1442, ep_reward: -16.8756570891012, ep_step: 11 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1443, ep_reward: -72.17169565691064, ep_step: 51 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1444, ep_reward: -35.48927157517943, ep_step: 15 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1445, ep_reward: -17.59577709156551, ep_step: 13 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1446, ep_reward: -30.841835819156852, ep_step: 41 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1447, ep_reward: -33.37732370643642, ep_step: 23 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1448, ep_reward: -50.66321430881172, ep_step: 34 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1449, ep_reward: -47.933232530188896, ep_step: 30 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1450, ep_reward: -36.87922309699812, ep_step: 22 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1451, ep_reward: -24.327572952689522, ep_step: 9 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1452, ep_reward: -27.390698866269084, ep_step: 16 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1453, ep_reward: -31.532962013567882, ep_step: 26 2023-05-26 14:10:45 - SimpleLog - INFO: - episode: 1454, ep_reward: -18.351453564086604, ep_step: 23 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1455, ep_reward: -139.04575302342698, ep_step: 68 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1456, ep_reward: -51.847629878632176, ep_step: 36 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1457, ep_reward: -35.07188844364632, ep_step: 23 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1458, ep_reward: -108.04632775832927, ep_step: 51 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1459, ep_reward: -149.17662202243474, ep_step: 68 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1460, ep_reward: -9.24691299323934, ep_step: 9 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1461, ep_reward: -22.41606739718791, ep_step: 10 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1462, ep_reward: -28.393934640043156, ep_step: 22 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1463, ep_reward: -11.073079545287435, ep_step: 8 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1464, ep_reward: -14.362666329614063, ep_step: 11 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1465, ep_reward: -54.68303237022943, ep_step: 27 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1466, ep_reward: -19.429099555796167, ep_step: 13 2023-05-26 14:10:46 - SimpleLog - INFO: - episode: 1467, ep_reward: -70.96522592157686, ep_step: 41 2023-05-26 14:10:47 - SimpleLog - INFO: - episode: 1468, ep_reward: -121.28400325520747, ep_step: 57 2023-05-26 14:10:47 - SimpleLog - INFO: - episode: 1469, ep_reward: -106.04375748400656, ep_step: 80 2023-05-26 14:10:47 - SimpleLog - INFO: - episode: 1470, ep_reward: -81.14910502728118, ep_step: 41 2023-05-26 14:10:47 - SimpleLog - INFO: - episode: 1471, ep_reward: -133.50796900299864, ep_step: 56 2023-05-26 14:10:47 - SimpleLog - INFO: - episode: 1472, ep_reward: -59.052960285312366, ep_step: 39 2023-05-26 14:10:47 - SimpleLog - INFO: - episode: 1473, ep_reward: -20.383789492046006, ep_step: 19 2023-05-26 14:10:47 - SimpleLog - INFO: - episode: 1474, ep_reward: -64.9109309639698, ep_step: 33 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1475, ep_reward: -58.46579635209981, ep_step: 54 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1476, ep_reward: -24.154415105689925, ep_step: 15 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1477, ep_reward: -77.61474921793737, ep_step: 43 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1478, ep_reward: -25.34963149773668, ep_step: 16 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1479, ep_reward: -25.620991607821356, ep_step: 13 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1480, ep_reward: -61.444070775996074, ep_step: 47 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1481, ep_reward: -39.2880646000605, ep_step: 26 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1482, ep_reward: -24.38399969963055, ep_step: 24 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1483, ep_reward: -72.06092211520738, ep_step: 61 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1484, ep_reward: -15.768892718472495, ep_step: 10 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1485, ep_reward: -31.038866892309432, ep_step: 20 2023-05-26 14:10:48 - SimpleLog - INFO: - episode: 1486, ep_reward: -11.040154302677568, ep_step: 9 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1487, ep_reward: -19.36256843287611, ep_step: 23 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1488, ep_reward: -20.259169802533723, ep_step: 13 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1489, ep_reward: -19.23307776962451, ep_step: 17 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1490, ep_reward: -10.805362483048002, ep_step: 10 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1491, ep_reward: -28.176665220823033, ep_step: 20 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1492, ep_reward: -176.03753038413726, ep_step: 104 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1493, ep_reward: -132.8113637947303, ep_step: 74 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1494, ep_reward: -44.487160715221115, ep_step: 18 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1495, ep_reward: -27.30777780250186, ep_step: 14 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1496, ep_reward: -44.19583588818047, ep_step: 19 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1497, ep_reward: -16.319432418020085, ep_step: 9 2023-05-26 14:10:49 - SimpleLog - INFO: - episode: 1498, ep_reward: -76.52290359726003, ep_step: 54 2023-05-26 14:10:50 - SimpleLog - INFO: - episode: 1499, ep_reward: -60.37553763875197, ep_step: 48 2023-05-26 14:10:50 - SimpleLog - INFO: - episode: 1500, ep_reward: -230.13412387714587, ep_step: 159 2023-05-26 14:10:50 - SimpleLog - INFO: - episode: 1501, ep_reward: -18.32323673280909, ep_step: 17 2023-05-26 14:10:50 - SimpleLog - INFO: - episode: 1502, ep_reward: -60.14267544635327, ep_step: 36 2023-05-26 14:10:50 - SimpleLog - INFO: - episode: 1503, ep_reward: -13.63084909117978, ep_step: 10 2023-05-26 14:10:50 - SimpleLog - INFO: - episode: 1504, ep_reward: -39.91056307984014, ep_step: 16 2023-05-26 14:10:50 - SimpleLog - INFO: - episode: 1505, ep_reward: -90.20277634549271, ep_step: 40 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1506, ep_reward: -71.26262940203213, ep_step: 35 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1507, ep_reward: -30.267518408348508, ep_step: 17 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1508, ep_reward: -89.72029492923771, ep_step: 58 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1509, ep_reward: -169.2191599353636, ep_step: 75 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1510, ep_reward: -44.24335142907692, ep_step: 25 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1511, ep_reward: -6.712314286680934, ep_step: 14 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1512, ep_reward: -52.15878044272639, ep_step: 43 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1513, ep_reward: -19.978197873792084, ep_step: 12 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1514, ep_reward: -45.701950594722895, ep_step: 29 2023-05-26 14:10:51 - SimpleLog - INFO: - episode: 1515, ep_reward: -33.02587692204485, ep_step: 31 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1516, ep_reward: -56.86909725547046, ep_step: 34 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1517, ep_reward: -15.302965533773374, ep_step: 10 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1518, ep_reward: -44.44404171639961, ep_step: 30 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1519, ep_reward: -171.97470694025026, ep_step: 78 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1520, ep_reward: -131.61023145702256, ep_step: 53 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1521, ep_reward: -41.717717870314615, ep_step: 37 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1522, ep_reward: -68.7721527851794, ep_step: 52 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1523, ep_reward: -19.999180517832738, ep_step: 16 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1524, ep_reward: -48.05096795650431, ep_step: 18 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1525, ep_reward: -48.94873835683814, ep_step: 21 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1526, ep_reward: -27.904341412109268, ep_step: 17 2023-05-26 14:10:52 - SimpleLog - INFO: - episode: 1527, ep_reward: -4.019607653726016, ep_step: 9 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1528, ep_reward: -54.32209218874405, ep_step: 32 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1529, ep_reward: -24.57306830529312, ep_step: 20 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1530, ep_reward: -19.724299176460555, ep_step: 16 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1531, ep_reward: -30.435604800597236, ep_step: 21 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1532, ep_reward: -34.73112993351539, ep_step: 30 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1533, ep_reward: -11.650916924551838, ep_step: 10 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1534, ep_reward: -95.57043006174898, ep_step: 36 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1535, ep_reward: -118.80922219359512, ep_step: 73 2023-05-26 14:10:53 - SimpleLog - INFO: - episode: 1536, ep_reward: -50.167850310651744, ep_step: 57 2023-05-26 14:10:56 - SimpleLog - INFO: - episode: 1537, ep_reward: -1783.603441490452, ep_step: 1000 2023-05-26 14:10:56 - SimpleLog - INFO: - episode: 1538, ep_reward: -35.15212310286132, ep_step: 20 2023-05-26 14:10:56 - SimpleLog - INFO: - episode: 1539, ep_reward: -13.461831639791754, ep_step: 12 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1540, ep_reward: -44.550893403244146, ep_step: 22 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1541, ep_reward: -72.61361621685805, ep_step: 40 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1542, ep_reward: -201.50263407626662, ep_step: 102 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1543, ep_reward: -41.69230643111747, ep_step: 26 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1544, ep_reward: -27.693978562113397, ep_step: 27 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1545, ep_reward: -26.211221684484308, ep_step: 15 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1546, ep_reward: -15.48715702434595, ep_step: 16 2023-05-26 14:10:57 - SimpleLog - INFO: - episode: 1547, ep_reward: -73.42798730704922, ep_step: 39 2023-05-26 14:10:58 - SimpleLog - INFO: - episode: 1548, ep_reward: -97.18543859317035, ep_step: 73 2023-05-26 14:10:58 - SimpleLog - INFO: - episode: 1549, ep_reward: -41.303251651673605, ep_step: 26 2023-05-26 14:10:58 - SimpleLog - INFO: - episode: 1550, ep_reward: -340.7257066096528, ep_step: 150 2023-05-26 14:10:58 - SimpleLog - INFO: - episode: 1551, ep_reward: -157.18491239791163, ep_step: 83 2023-05-26 14:10:58 - SimpleLog - INFO: - episode: 1552, ep_reward: -56.15272960711123, ep_step: 28 2023-05-26 14:10:58 - SimpleLog - INFO: - episode: 1553, ep_reward: -8.831750989898437, ep_step: 10 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1554, ep_reward: -83.24081602700613, ep_step: 71 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1555, ep_reward: -42.62345808159552, ep_step: 34 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1556, ep_reward: -71.9456433607278, ep_step: 58 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1557, ep_reward: -44.93966040295914, ep_step: 25 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1558, ep_reward: -122.81832838608295, ep_step: 66 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1559, ep_reward: -21.10132522056609, ep_step: 17 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1560, ep_reward: -46.00682894803379, ep_step: 20 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1561, ep_reward: -69.80779059344039, ep_step: 65 2023-05-26 14:10:59 - SimpleLog - INFO: - episode: 1562, ep_reward: -33.99660595136726, ep_step: 28 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1563, ep_reward: -32.66350254877137, ep_step: 25 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1564, ep_reward: -24.558303067095583, ep_step: 30 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1565, ep_reward: -30.95941433120717, ep_step: 27 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1566, ep_reward: -34.25990218293399, ep_step: 22 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1567, ep_reward: -92.24724186991591, ep_step: 103 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1568, ep_reward: -61.0206364688881, ep_step: 32 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1569, ep_reward: -33.731262119809095, ep_step: 15 2023-05-26 14:11:00 - SimpleLog - INFO: - episode: 1570, ep_reward: -31.381102094450235, ep_step: 44 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1571, ep_reward: -40.467003534751946, ep_step: 26 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1572, ep_reward: -25.943625959254824, ep_step: 10 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1573, ep_reward: -28.242274486095624, ep_step: 20 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1574, ep_reward: -13.35275968135496, ep_step: 10 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1575, ep_reward: -118.66548875172718, ep_step: 84 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1576, ep_reward: -38.373904203704775, ep_step: 16 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1577, ep_reward: -103.15535571730952, ep_step: 53 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1578, ep_reward: -239.68708206775327, ep_step: 117 2023-05-26 14:11:01 - SimpleLog - INFO: - episode: 1579, ep_reward: -35.45978003243852, ep_step: 22 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1580, ep_reward: -95.41649380920971, ep_step: 67 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1581, ep_reward: -37.987802316955694, ep_step: 26 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1582, ep_reward: -51.09106037200034, ep_step: 35 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1583, ep_reward: -12.573365540516672, ep_step: 10 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1584, ep_reward: -18.807777878555527, ep_step: 34 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1585, ep_reward: -32.62182154061862, ep_step: 20 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1586, ep_reward: -30.884460677023775, ep_step: 15 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1587, ep_reward: -43.64815648590906, ep_step: 21 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1588, ep_reward: -69.88099444284126, ep_step: 32 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1589, ep_reward: -21.678499799211554, ep_step: 10 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1590, ep_reward: -14.254655388146785, ep_step: 16 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1591, ep_reward: -40.033115350172174, ep_step: 23 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1592, ep_reward: -20.41896651009382, ep_step: 9 2023-05-26 14:11:02 - SimpleLog - INFO: - episode: 1593, ep_reward: -75.39729933089644, ep_step: 50 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1594, ep_reward: -45.31271976867101, ep_step: 33 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1595, ep_reward: -64.3024050002314, ep_step: 35 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1596, ep_reward: -5.437317487017399, ep_step: 49 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1597, ep_reward: -68.85777873079422, ep_step: 51 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1598, ep_reward: -72.45002805700325, ep_step: 32 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1599, ep_reward: -25.59500521768847, ep_step: 9 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1600, ep_reward: -13.414486137633524, ep_step: 10 2023-05-26 14:11:03 - SimpleLog - INFO: - episode: 1601, ep_reward: -52.03361321799678, ep_step: 30 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1602, ep_reward: -114.33522333141788, ep_step: 63 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1603, ep_reward: -22.192994039157984, ep_step: 23 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1604, ep_reward: -53.520514580191275, ep_step: 25 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1605, ep_reward: -4.212121670165397, ep_step: 35 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1606, ep_reward: -19.697580289425126, ep_step: 12 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1607, ep_reward: -64.50659651846051, ep_step: 34 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1608, ep_reward: -33.89917621257287, ep_step: 36 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1609, ep_reward: -55.019024813026846, ep_step: 26 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1610, ep_reward: -11.244103393675239, ep_step: 8 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1611, ep_reward: -36.884571353676854, ep_step: 31 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1612, ep_reward: -32.331954564014396, ep_step: 16 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1613, ep_reward: -106.23604016281753, ep_step: 75 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1614, ep_reward: -11.649494234572352, ep_step: 9 2023-05-26 14:11:04 - SimpleLog - INFO: - episode: 1615, ep_reward: -46.404541517104256, ep_step: 21 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1616, ep_reward: -138.14347638720608, ep_step: 65 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1617, ep_reward: -13.656118562977753, ep_step: 11 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1618, ep_reward: -29.02715766423983, ep_step: 33 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1619, ep_reward: -46.72826158374037, ep_step: 29 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1620, ep_reward: -69.87200766965974, ep_step: 32 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1621, ep_reward: -35.57746724995548, ep_step: 18 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1622, ep_reward: -188.86250926824584, ep_step: 95 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1623, ep_reward: -42.44618215626428, ep_step: 17 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1624, ep_reward: -150.5487338589811, ep_step: 50 2023-05-26 14:11:05 - SimpleLog - INFO: - episode: 1625, ep_reward: -15.337491855010931, ep_step: 11 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1626, ep_reward: -23.01479749366028, ep_step: 23 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1627, ep_reward: -103.13514583076972, ep_step: 43 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1628, ep_reward: -57.44542034991463, ep_step: 37 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1629, ep_reward: -31.096905124110098, ep_step: 13 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1630, ep_reward: -159.14673106910996, ep_step: 77 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1631, ep_reward: -6.131375382416392, ep_step: 19 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1632, ep_reward: -12.641071709364407, ep_step: 9 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1633, ep_reward: -50.29423249915731, ep_step: 52 2023-05-26 14:11:06 - SimpleLog - INFO: - episode: 1634, ep_reward: -21.006527661970456, ep_step: 17 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1635, ep_reward: -74.4881796231643, ep_step: 32 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1636, ep_reward: -45.68870754439078, ep_step: 47 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1637, ep_reward: -17.499899193884477, ep_step: 14 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1638, ep_reward: -24.764043007802215, ep_step: 16 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1639, ep_reward: -33.01325012716601, ep_step: 38 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1640, ep_reward: -97.56658940766893, ep_step: 43 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1641, ep_reward: -44.708190064907186, ep_step: 26 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1642, ep_reward: -32.33729325017746, ep_step: 19 2023-05-26 14:11:07 - SimpleLog - INFO: - episode: 1643, ep_reward: -84.33940645479039, ep_step: 43 2023-05-26 14:11:08 - SimpleLog - INFO: - episode: 1644, ep_reward: -27.7696787013001, ep_step: 14 2023-05-26 14:11:08 - SimpleLog - INFO: - episode: 1645, ep_reward: -15.20163359641892, ep_step: 14 2023-05-26 14:11:08 - SimpleLog - INFO: - episode: 1646, ep_reward: -101.27049266197167, ep_step: 37 2023-05-26 14:11:08 - SimpleLog - INFO: - episode: 1647, ep_reward: -17.916948968897916, ep_step: 11 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1648, ep_reward: -1780.8442542691573, ep_step: 1000 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1649, ep_reward: -12.236741524276912, ep_step: 8 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1650, ep_reward: -50.50186993789381, ep_step: 52 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1651, ep_reward: -27.293557699705673, ep_step: 26 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1652, ep_reward: -16.356137783242705, ep_step: 11 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1653, ep_reward: -158.45485875313074, ep_step: 88 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1654, ep_reward: -67.65564809208482, ep_step: 52 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1655, ep_reward: -71.90853241213088, ep_step: 43 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1656, ep_reward: -18.4446135842931, ep_step: 12 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1657, ep_reward: -17.770205585669945, ep_step: 11 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1658, ep_reward: -11.54485907192559, ep_step: 9 2023-05-26 14:11:11 - SimpleLog - INFO: - episode: 1659, ep_reward: -17.820448559076844, ep_step: 11 2023-05-26 14:11:12 - SimpleLog - INFO: - episode: 1660, ep_reward: -114.3747743929327, ep_step: 74 2023-05-26 14:11:12 - SimpleLog - INFO: - episode: 1661, ep_reward: -25.159988911223692, ep_step: 16 2023-05-26 14:11:12 - SimpleLog - INFO: - episode: 1662, ep_reward: -8.411933578747401, ep_step: 10 2023-05-26 14:11:12 - SimpleLog - INFO: - episode: 1663, ep_reward: -18.931879193812307, ep_step: 21 2023-05-26 14:11:12 - SimpleLog - INFO: - episode: 1664, ep_reward: -18.922495655333655, ep_step: 27 2023-05-26 14:11:12 - SimpleLog - INFO: - episode: 1665, ep_reward: -161.79735219982496, ep_step: 68 2023-05-26 14:11:15 - SimpleLog - INFO: - episode: 1666, ep_reward: -1737.7483667443123, ep_step: 1000 2023-05-26 14:11:17 - SimpleLog - INFO: - episode: 1667, ep_reward: -1181.2085930527062, ep_step: 630 2023-05-26 14:11:17 - SimpleLog - INFO: - episode: 1668, ep_reward: -79.77885724592994, ep_step: 32 2023-05-26 14:11:17 - SimpleLog - INFO: - episode: 1669, ep_reward: -14.111558375928979, ep_step: 8 2023-05-26 14:11:17 - SimpleLog - INFO: - episode: 1670, ep_reward: -88.10772367791857, ep_step: 42 2023-05-26 14:11:17 - SimpleLog - INFO: - episode: 1671, ep_reward: -62.6897456332379, ep_step: 34 2023-05-26 14:11:17 - SimpleLog - INFO: - episode: 1672, ep_reward: -24.48222410547664, ep_step: 30 2023-05-26 14:11:17 - SimpleLog - INFO: - episode: 1673, ep_reward: -53.354293518239835, ep_step: 32 2023-05-26 14:11:18 - SimpleLog - INFO: - episode: 1674, ep_reward: -35.524838658951936, ep_step: 23 2023-05-26 14:11:18 - SimpleLog - INFO: - episode: 1675, ep_reward: -69.97831681774088, ep_step: 46 2023-05-26 14:11:18 - SimpleLog - INFO: - episode: 1676, ep_reward: -20.164066021643514, ep_step: 18 2023-05-26 14:11:18 - SimpleLog - INFO: - episode: 1677, ep_reward: -46.64293167153668, ep_step: 15 2023-05-26 14:11:18 - SimpleLog - INFO: - episode: 1678, ep_reward: -298.9125252460816, ep_step: 160 2023-05-26 14:11:18 - SimpleLog - INFO: - episode: 1679, ep_reward: -183.13481755140498, ep_step: 80 2023-05-26 14:11:18 - SimpleLog - INFO: - episode: 1680, ep_reward: -20.579876601338796, ep_step: 10 2023-05-26 14:11:19 - SimpleLog - INFO: - episode: 1681, ep_reward: -84.41398046171022, ep_step: 38 2023-05-26 14:11:19 - SimpleLog - INFO: - episode: 1682, ep_reward: -93.78319661903357, ep_step: 40 2023-05-26 14:11:19 - SimpleLog - INFO: - episode: 1683, ep_reward: -16.12585677201163, ep_step: 14 2023-05-26 14:11:19 - SimpleLog - INFO: - episode: 1684, ep_reward: -28.321038781371758, ep_step: 46 2023-05-26 14:11:19 - SimpleLog - INFO: - episode: 1685, ep_reward: -40.864157868476184, ep_step: 28 2023-05-26 14:11:19 - SimpleLog - INFO: - episode: 1686, ep_reward: -30.185199442555348, ep_step: 11 2023-05-26 14:11:19 - SimpleLog - INFO: - episode: 1687, ep_reward: -92.53477905457602, ep_step: 37 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1688, ep_reward: -134.9915262431979, ep_step: 81 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1689, ep_reward: -62.43796148875324, ep_step: 25 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1690, ep_reward: -79.43462217638377, ep_step: 33 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1691, ep_reward: -21.474652286230516, ep_step: 18 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1692, ep_reward: -34.388642932677925, ep_step: 21 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1693, ep_reward: -106.01221993908207, ep_step: 69 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1694, ep_reward: -34.950167459045915, ep_step: 27 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1695, ep_reward: -10.041231113512056, ep_step: 9 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1696, ep_reward: -44.9280362318083, ep_step: 22 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1697, ep_reward: -20.241718716867013, ep_step: 19 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1698, ep_reward: -48.15521264485975, ep_step: 23 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1699, ep_reward: -11.342722226900715, ep_step: 18 2023-05-26 14:11:20 - SimpleLog - INFO: - episode: 1700, ep_reward: -73.13322625753213, ep_step: 36 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1701, ep_reward: -12.488942864728628, ep_step: 10 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1702, ep_reward: -46.323788015397064, ep_step: 28 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1703, ep_reward: -80.60655849130116, ep_step: 60 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1704, ep_reward: -26.051076641407708, ep_step: 16 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1705, ep_reward: -48.1376294566685, ep_step: 24 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1706, ep_reward: -62.038580134996735, ep_step: 32 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1707, ep_reward: -45.194843256773844, ep_step: 33 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1708, ep_reward: -28.294260450569396, ep_step: 13 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1709, ep_reward: -36.55942209921921, ep_step: 28 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1710, ep_reward: -20.390180968206817, ep_step: 12 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1711, ep_reward: -33.6419407378175, ep_step: 29 2023-05-26 14:11:21 - SimpleLog - INFO: - episode: 1712, ep_reward: -61.402007631309324, ep_step: 28 2023-05-26 14:11:24 - SimpleLog - INFO: - episode: 1713, ep_reward: -1743.9077518115832, ep_step: 1000 2023-05-26 14:11:24 - SimpleLog - INFO: - episode: 1714, ep_reward: -11.440485578292682, ep_step: 14 2023-05-26 14:11:24 - SimpleLog - INFO: - episode: 1715, ep_reward: -19.77669841326865, ep_step: 11 2023-05-26 14:11:25 - SimpleLog - INFO: - episode: 1716, ep_reward: -131.79759914769838, ep_step: 67 2023-05-26 14:11:25 - SimpleLog - INFO: - episode: 1717, ep_reward: -22.711985334335893, ep_step: 10 2023-05-26 14:11:25 - SimpleLog - INFO: - episode: 1718, ep_reward: -20.16651518293471, ep_step: 18 2023-05-26 14:11:25 - SimpleLog - INFO: - episode: 1719, ep_reward: -353.7149035429384, ep_step: 199 2023-05-26 14:11:25 - SimpleLog - INFO: - episode: 1720, ep_reward: -39.33851402914946, ep_step: 22 2023-05-26 14:11:25 - SimpleLog - INFO: - episode: 1721, ep_reward: -33.832669557844696, ep_step: 31 2023-05-26 14:11:25 - SimpleLog - INFO: - episode: 1722, ep_reward: -14.034642827214537, ep_step: 14 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1723, ep_reward: -65.2995039942881, ep_step: 35 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1724, ep_reward: -36.761744900006306, ep_step: 28 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1725, ep_reward: -17.74996495960879, ep_step: 12 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1726, ep_reward: -62.40730908866599, ep_step: 38 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1727, ep_reward: -10.982475671659907, ep_step: 9 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1728, ep_reward: -96.03312778023384, ep_step: 49 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1729, ep_reward: -17.14995825916896, ep_step: 21 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1730, ep_reward: -82.44289871935489, ep_step: 45 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1731, ep_reward: -47.92198026849888, ep_step: 42 2023-05-26 14:11:26 - SimpleLog - INFO: - episode: 1732, ep_reward: -53.58702368111865, ep_step: 23 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1733, ep_reward: -118.9636524720164, ep_step: 67 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1734, ep_reward: -58.20420376205815, ep_step: 37 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1735, ep_reward: -44.811410452902, ep_step: 28 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1736, ep_reward: -37.476602839471774, ep_step: 33 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1737, ep_reward: -18.59608090992304, ep_step: 10 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1738, ep_reward: -108.09820579903679, ep_step: 60 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1739, ep_reward: -20.443884936393218, ep_step: 10 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1740, ep_reward: -53.07813744197977, ep_step: 33 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1741, ep_reward: -31.854636516397477, ep_step: 20 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1742, ep_reward: -34.72480669813905, ep_step: 20 2023-05-26 14:11:27 - SimpleLog - INFO: - episode: 1743, ep_reward: -12.95885993086626, ep_step: 10 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1744, ep_reward: -101.90121628409555, ep_step: 62 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1745, ep_reward: -12.58533134113688, ep_step: 11 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1746, ep_reward: -11.541183083069088, ep_step: 12 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1747, ep_reward: -21.2119495075221, ep_step: 19 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1748, ep_reward: -31.07008629729698, ep_step: 18 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1749, ep_reward: -37.07709142037255, ep_step: 19 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1750, ep_reward: -14.931386513424835, ep_step: 12 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1751, ep_reward: -14.206900573486909, ep_step: 11 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1752, ep_reward: -118.18970863541364, ep_step: 55 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1753, ep_reward: -101.01864254521351, ep_step: 101 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1754, ep_reward: -14.151513993022066, ep_step: 30 2023-05-26 14:11:28 - SimpleLog - INFO: - episode: 1755, ep_reward: -25.571704332469565, ep_step: 14 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1756, ep_reward: -59.45190657452493, ep_step: 43 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1757, ep_reward: -47.09459146936349, ep_step: 30 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1758, ep_reward: -64.85883353183458, ep_step: 33 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1759, ep_reward: -50.55404270059888, ep_step: 27 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1760, ep_reward: -9.331132230429109, ep_step: 16 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1761, ep_reward: -56.54405248105984, ep_step: 32 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1762, ep_reward: -122.63771076844196, ep_step: 63 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1763, ep_reward: -16.33279942494635, ep_step: 13 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1764, ep_reward: -15.939330539277242, ep_step: 12 2023-05-26 14:11:29 - SimpleLog - INFO: - episode: 1765, ep_reward: -17.07147650406162, ep_step: 19 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1766, ep_reward: -49.05283117368346, ep_step: 36 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1767, ep_reward: -41.9566573633832, ep_step: 32 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1768, ep_reward: -190.1351140756528, ep_step: 101 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1769, ep_reward: -20.576617821461337, ep_step: 12 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1770, ep_reward: -43.57037448500332, ep_step: 21 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1771, ep_reward: -35.71754286536463, ep_step: 32 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1772, ep_reward: -136.63046182694032, ep_step: 85 2023-05-26 14:11:30 - SimpleLog - INFO: - episode: 1773, ep_reward: -19.941015974021788, ep_step: 33 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1774, ep_reward: -89.90031080451867, ep_step: 57 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1775, ep_reward: -23.534178865497044, ep_step: 22 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1776, ep_reward: -28.16859688326591, ep_step: 17 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1777, ep_reward: -10.923365911731208, ep_step: 11 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1778, ep_reward: -12.948505851924242, ep_step: 9 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1779, ep_reward: -37.99520697590834, ep_step: 29 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1780, ep_reward: -34.85130495796788, ep_step: 29 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1781, ep_reward: -9.742528417773823, ep_step: 11 2023-05-26 14:11:31 - SimpleLog - INFO: - episode: 1782, ep_reward: -12.038598959637005, ep_step: 10 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1783, ep_reward: -287.2427145788501, ep_step: 204 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1784, ep_reward: -44.98930690376244, ep_step: 22 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1785, ep_reward: -89.18094486496985, ep_step: 32 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1786, ep_reward: -11.591425884974749, ep_step: 14 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1787, ep_reward: -50.81631995946879, ep_step: 38 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1788, ep_reward: -54.65131053210545, ep_step: 43 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1789, ep_reward: -8.527558657856954, ep_step: 12 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1790, ep_reward: -16.79679093858214, ep_step: 12 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1791, ep_reward: -43.06427407841408, ep_step: 14 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1792, ep_reward: -51.75307114575216, ep_step: 33 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1793, ep_reward: -25.368308626544408, ep_step: 11 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1794, ep_reward: -20.280155771409824, ep_step: 11 2023-05-26 14:11:32 - SimpleLog - INFO: - episode: 1795, ep_reward: -23.682994651670917, ep_step: 23 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1796, ep_reward: -65.01850462677085, ep_step: 37 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1797, ep_reward: -82.27799449582582, ep_step: 61 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1798, ep_reward: -16.477178456714853, ep_step: 20 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1799, ep_reward: -41.78899649665815, ep_step: 22 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1800, ep_reward: -17.11347516956712, ep_step: 9 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1801, ep_reward: -14.375566160053634, ep_step: 10 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1802, ep_reward: -39.91558466232095, ep_step: 25 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1803, ep_reward: -38.36251078487487, ep_step: 28 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1804, ep_reward: -34.99275564544641, ep_step: 16 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1805, ep_reward: -41.76185273961532, ep_step: 18 2023-05-26 14:11:33 - SimpleLog - INFO: - episode: 1806, ep_reward: -35.95451762606259, ep_step: 31 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1807, ep_reward: -9.091178173709014, ep_step: 9 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1808, ep_reward: -64.74031000712269, ep_step: 40 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1809, ep_reward: -16.730926795562475, ep_step: 16 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1810, ep_reward: -107.22486902090199, ep_step: 45 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1811, ep_reward: -135.92667636336967, ep_step: 72 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1812, ep_reward: -22.1645156695591, ep_step: 27 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1813, ep_reward: -15.947362975102838, ep_step: 12 2023-05-26 14:11:34 - SimpleLog - INFO: - episode: 1814, ep_reward: -65.5979138001677, ep_step: 31 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1815, ep_reward: -71.24947432062177, ep_step: 33 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1816, ep_reward: -43.451310182799546, ep_step: 22 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1817, ep_reward: -15.472066605377899, ep_step: 37 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1818, ep_reward: -18.251616077322787, ep_step: 17 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1819, ep_reward: -50.25513187521184, ep_step: 45 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1820, ep_reward: -91.25102831100052, ep_step: 41 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1821, ep_reward: -71.5246511754255, ep_step: 62 2023-05-26 14:11:35 - SimpleLog - INFO: - episode: 1822, ep_reward: -141.7073443241731, ep_step: 77 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1823, ep_reward: -55.25917790506094, ep_step: 38 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1824, ep_reward: -59.709589244664365, ep_step: 28 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1825, ep_reward: -62.71641182803099, ep_step: 49 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1826, ep_reward: -26.55778405769808, ep_step: 20 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1827, ep_reward: -51.22959768599557, ep_step: 26 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1828, ep_reward: -97.56859922770555, ep_step: 36 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1829, ep_reward: -19.595301409223854, ep_step: 12 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1830, ep_reward: -10.390553986461285, ep_step: 9 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1831, ep_reward: -8.254496090400393, ep_step: 12 2023-05-26 14:11:36 - SimpleLog - INFO: - episode: 1832, ep_reward: -42.89464324084468, ep_step: 19 2023-05-26 14:11:38 - SimpleLog - INFO: - episode: 1833, ep_reward: -1359.7534280866666, ep_step: 767 2023-05-26 14:11:38 - SimpleLog - INFO: - episode: 1834, ep_reward: -20.369826045499053, ep_step: 21 2023-05-26 14:11:38 - SimpleLog - INFO: - episode: 1835, ep_reward: -28.384526202812005, ep_step: 14 2023-05-26 14:11:38 - SimpleLog - INFO: - episode: 1836, ep_reward: -16.1839944338349, ep_step: 11 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1837, ep_reward: -26.6958453073561, ep_step: 15 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1838, ep_reward: -21.727308161742876, ep_step: 18 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1839, ep_reward: -130.23563165018388, ep_step: 42 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1840, ep_reward: -24.128459738467775, ep_step: 24 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1841, ep_reward: -15.738291906228627, ep_step: 14 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1842, ep_reward: -9.170628310804084, ep_step: 11 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1843, ep_reward: -39.07330616599452, ep_step: 33 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1844, ep_reward: -39.31201286285997, ep_step: 24 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1845, ep_reward: -12.521424162005188, ep_step: 8 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1846, ep_reward: -101.60996269612913, ep_step: 67 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1847, ep_reward: -39.14885422793549, ep_step: 48 2023-05-26 14:11:39 - SimpleLog - INFO: - episode: 1848, ep_reward: -83.07535435065623, ep_step: 51 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1849, ep_reward: -55.48687248346016, ep_step: 36 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1850, ep_reward: -27.52432464480792, ep_step: 12 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1851, ep_reward: -91.24587076380617, ep_step: 67 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1852, ep_reward: -77.67905538596779, ep_step: 49 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1853, ep_reward: -81.41733080894056, ep_step: 43 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1854, ep_reward: -117.6536194558045, ep_step: 49 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1855, ep_reward: -14.69562861227697, ep_step: 11 2023-05-26 14:11:40 - SimpleLog - INFO: - episode: 1856, ep_reward: -14.500852054379145, ep_step: 12 2023-05-26 14:11:43 - SimpleLog - INFO: - episode: 1857, ep_reward: -1762.4754758289735, ep_step: 1000 2023-05-26 14:11:43 - SimpleLog - INFO: - episode: 1858, ep_reward: -68.28987793945785, ep_step: 30 2023-05-26 14:11:43 - SimpleLog - INFO: - episode: 1859, ep_reward: -51.78568821252321, ep_step: 55 2023-05-26 14:11:43 - SimpleLog - INFO: - episode: 1860, ep_reward: -25.131325259257526, ep_step: 18 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1861, ep_reward: -44.14868362088999, ep_step: 41 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1862, ep_reward: -34.30165218219431, ep_step: 23 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1863, ep_reward: -16.780454627615036, ep_step: 21 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1864, ep_reward: -80.30348920940946, ep_step: 42 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1865, ep_reward: -16.656879666318208, ep_step: 11 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1866, ep_reward: -83.16322837146211, ep_step: 30 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1867, ep_reward: -18.342205729556703, ep_step: 10 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1868, ep_reward: -149.4431819249873, ep_step: 105 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1869, ep_reward: -22.12603998282618, ep_step: 10 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1870, ep_reward: -71.96304330276524, ep_step: 48 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1871, ep_reward: -28.15640354204739, ep_step: 15 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1872, ep_reward: -12.933721661168239, ep_step: 8 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1873, ep_reward: -26.68682040019324, ep_step: 11 2023-05-26 14:11:44 - SimpleLog - INFO: - episode: 1874, ep_reward: -22.3258302639481, ep_step: 24 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1875, ep_reward: -25.839919223910695, ep_step: 20 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1876, ep_reward: -78.15625788073723, ep_step: 36 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1877, ep_reward: -15.217142875796457, ep_step: 13 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1878, ep_reward: -97.15902104578838, ep_step: 50 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1879, ep_reward: -64.72778689951109, ep_step: 40 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1880, ep_reward: -102.76747543425535, ep_step: 75 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1881, ep_reward: -13.580591252171132, ep_step: 22 2023-05-26 14:11:45 - SimpleLog - INFO: - episode: 1882, ep_reward: -18.82464413055459, ep_step: 21 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1883, ep_reward: -46.2176360731682, ep_step: 48 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1884, ep_reward: -10.254624744788838, ep_step: 10 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1885, ep_reward: -125.07197352089511, ep_step: 95 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1886, ep_reward: -76.61299487206838, ep_step: 42 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1887, ep_reward: -28.11553920829571, ep_step: 26 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1888, ep_reward: -55.19271415798143, ep_step: 36 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1889, ep_reward: -44.70505410167311, ep_step: 29 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1890, ep_reward: -85.7884248507115, ep_step: 71 2023-05-26 14:11:46 - SimpleLog - INFO: - episode: 1891, ep_reward: -16.032343044592583, ep_step: 14 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1892, ep_reward: -20.2752612662983, ep_step: 13 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1893, ep_reward: -25.353954467585332, ep_step: 23 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1894, ep_reward: -60.66290588562633, ep_step: 20 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1895, ep_reward: -14.506406807594185, ep_step: 11 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1896, ep_reward: -43.43741097037558, ep_step: 23 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1897, ep_reward: -39.241856518447406, ep_step: 25 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1898, ep_reward: -41.63854934742244, ep_step: 19 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1899, ep_reward: -10.076361896569189, ep_step: 13 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1900, ep_reward: -42.9002038355698, ep_step: 44 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1901, ep_reward: -14.604728002557282, ep_step: 20 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1902, ep_reward: -25.130004240974493, ep_step: 14 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1903, ep_reward: -41.06634458006719, ep_step: 14 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1904, ep_reward: -10.418989457697677, ep_step: 9 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1905, ep_reward: -88.80400136152625, ep_step: 65 2023-05-26 14:11:47 - SimpleLog - INFO: - episode: 1906, ep_reward: -42.30970944656846, ep_step: 23 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1907, ep_reward: -37.47470056046916, ep_step: 19 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1908, ep_reward: -113.08978080310754, ep_step: 58 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1909, ep_reward: -71.56852109104804, ep_step: 42 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1910, ep_reward: -42.70167082075004, ep_step: 30 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1911, ep_reward: -78.69003764880438, ep_step: 46 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1912, ep_reward: -19.554132002626005, ep_step: 10 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1913, ep_reward: -17.173139933048184, ep_step: 30 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1914, ep_reward: -31.413148868391996, ep_step: 15 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1915, ep_reward: -42.96419723090616, ep_step: 42 2023-05-26 14:11:48 - SimpleLog - INFO: - episode: 1916, ep_reward: -26.740605743245904, ep_step: 26 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1917, ep_reward: -59.86211306463029, ep_step: 41 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1918, ep_reward: -38.258663348993565, ep_step: 20 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1919, ep_reward: -24.27083870576507, ep_step: 12 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1920, ep_reward: -55.67820726105111, ep_step: 27 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1921, ep_reward: -10.184871585765684, ep_step: 9 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1922, ep_reward: -61.181335843412924, ep_step: 31 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1923, ep_reward: -119.72862474882854, ep_step: 84 2023-05-26 14:11:49 - SimpleLog - INFO: - episode: 1924, ep_reward: -49.21031443208523, ep_step: 49 2023-05-26 14:11:50 - SimpleLog - INFO: - episode: 1925, ep_reward: -121.09941050557899, ep_step: 52 2023-05-26 14:11:50 - SimpleLog - INFO: - episode: 1926, ep_reward: -11.06097143722818, ep_step: 8 2023-05-26 14:11:50 - SimpleLog - INFO: - episode: 1927, ep_reward: -19.077551654905132, ep_step: 12 2023-05-26 14:11:50 - SimpleLog - INFO: - episode: 1928, ep_reward: -145.13781102696026, ep_step: 90 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1929, ep_reward: -1130.3494028071225, ep_step: 637 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1930, ep_reward: -12.660358350395267, ep_step: 10 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1931, ep_reward: -82.70342133743755, ep_step: 36 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1932, ep_reward: -56.892788959740166, ep_step: 22 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1933, ep_reward: -25.895539189841635, ep_step: 16 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1934, ep_reward: -55.3945838360727, ep_step: 34 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1935, ep_reward: -31.599003669819393, ep_step: 30 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1936, ep_reward: -80.39925431150063, ep_step: 44 2023-05-26 14:11:52 - SimpleLog - INFO: - episode: 1937, ep_reward: -63.70237390344558, ep_step: 33 2023-05-26 14:11:55 - SimpleLog - INFO: - episode: 1938, ep_reward: -1673.0534810075158, ep_step: 1000 2023-05-26 14:11:55 - SimpleLog - INFO: - episode: 1939, ep_reward: -29.43432180869013, ep_step: 20 2023-05-26 14:11:56 - SimpleLog - INFO: - episode: 1940, ep_reward: -315.5216337719817, ep_step: 140 2023-05-26 14:11:56 - SimpleLog - INFO: - episode: 1941, ep_reward: -50.656022770159865, ep_step: 28 2023-05-26 14:11:56 - SimpleLog - INFO: - episode: 1942, ep_reward: -123.96539751223389, ep_step: 47 2023-05-26 14:11:56 - SimpleLog - INFO: - episode: 1943, ep_reward: -21.250177338379665, ep_step: 15 2023-05-26 14:11:56 - SimpleLog - INFO: - episode: 1944, ep_reward: -121.64579163217897, ep_step: 62 2023-05-26 14:11:56 - SimpleLog - INFO: - episode: 1945, ep_reward: -49.76964561322874, ep_step: 24 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1946, ep_reward: -16.64288443194912, ep_step: 15 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1947, ep_reward: -44.185463065854776, ep_step: 19 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1948, ep_reward: -21.167652450464935, ep_step: 19 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1949, ep_reward: -96.60490324377201, ep_step: 40 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1950, ep_reward: -89.59117403684192, ep_step: 87 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1951, ep_reward: -11.76892153016779, ep_step: 12 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1952, ep_reward: -57.844954863866306, ep_step: 33 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1953, ep_reward: -21.071389313258468, ep_step: 11 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1954, ep_reward: -51.77700763653375, ep_step: 30 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1955, ep_reward: -45.98330683656348, ep_step: 36 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1956, ep_reward: -15.931474639898955, ep_step: 11 2023-05-26 14:11:57 - SimpleLog - INFO: - episode: 1957, ep_reward: -38.68067812931596, ep_step: 26 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1958, ep_reward: -99.7112858598156, ep_step: 45 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1959, ep_reward: -19.53656080072165, ep_step: 11 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1960, ep_reward: -29.316168333975842, ep_step: 20 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1961, ep_reward: -99.95099758232524, ep_step: 51 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1962, ep_reward: -22.53876066096432, ep_step: 17 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1963, ep_reward: -55.20973920986353, ep_step: 39 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1964, ep_reward: -42.39781452934861, ep_step: 43 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1965, ep_reward: -192.0506778682291, ep_step: 87 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1966, ep_reward: -67.75569293382993, ep_step: 41 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1967, ep_reward: -27.56505068837792, ep_step: 17 2023-05-26 14:11:58 - SimpleLog - INFO: - episode: 1968, ep_reward: -9.74523094897197, ep_step: 18 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1969, ep_reward: -37.05640038760807, ep_step: 35 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1970, ep_reward: -58.370013481285866, ep_step: 33 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1971, ep_reward: -58.955730581660404, ep_step: 42 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1972, ep_reward: -33.68247717513112, ep_step: 24 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1973, ep_reward: -53.45822252128684, ep_step: 32 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1974, ep_reward: -114.67013416022223, ep_step: 51 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1975, ep_reward: -31.39970209206239, ep_step: 22 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1976, ep_reward: -27.361474465721454, ep_step: 18 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1977, ep_reward: -30.59529042450545, ep_step: 13 2023-05-26 14:11:59 - SimpleLog - INFO: - episode: 1978, ep_reward: -19.83829314267784, ep_step: 14 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1979, ep_reward: -60.12999503071646, ep_step: 35 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1980, ep_reward: -53.50014523959603, ep_step: 29 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1981, ep_reward: -104.04613916349933, ep_step: 61 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1982, ep_reward: -10.897313379585166, ep_step: 9 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1983, ep_reward: -100.56894253392666, ep_step: 55 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1984, ep_reward: -58.424623360893584, ep_step: 34 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1985, ep_reward: -104.79887786130087, ep_step: 51 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1986, ep_reward: -10.716195230836316, ep_step: 9 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1987, ep_reward: -22.746241048919924, ep_step: 10 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1988, ep_reward: -75.48974854638158, ep_step: 38 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1989, ep_reward: -27.222056773729037, ep_step: 17 2023-05-26 14:12:00 - SimpleLog - INFO: - episode: 1990, ep_reward: -25.71306894260563, ep_step: 24 2023-05-26 14:12:01 - SimpleLog - INFO: - episode: 1991, ep_reward: -19.012066218636747, ep_step: 15 2023-05-26 14:12:01 - SimpleLog - INFO: - episode: 1992, ep_reward: -48.894711908128215, ep_step: 21 2023-05-26 14:12:01 - SimpleLog - INFO: - episode: 1993, ep_reward: -50.300062305729234, ep_step: 47 2023-05-26 14:12:01 - SimpleLog - INFO: - episode: 1994, ep_reward: -30.43917032782407, ep_step: 13 2023-05-26 14:12:02 - SimpleLog - INFO: - episode: 1995, ep_reward: -826.0753765890894, ep_step: 458 2023-05-26 14:12:02 - SimpleLog - INFO: - episode: 1996, ep_reward: -65.59466131092775, ep_step: 89 2023-05-26 14:12:02 - SimpleLog - INFO: - episode: 1997, ep_reward: -31.513286544095514, ep_step: 22 2023-05-26 14:12:03 - SimpleLog - INFO: - episode: 1998, ep_reward: -38.28046821675985, ep_step: 24 2023-05-26 14:12:03 - SimpleLog - INFO: - episode: 1999, ep_reward: -62.91517589932144, ep_step: 32 2023-05-26 14:12:03 - SimpleLog - INFO: - Finish training! total time consumed: 480.11s