| 2023-05-19 01:08:04 - SimpleLog - INFO: - General Configs: | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================ | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - Name Value Type | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - env_name gym <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - algo_name Sarsa <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - mode train <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - device cpu <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - seed 1 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - max_episode 300 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - max_step 100 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - collect_traj 0 <class 'bool'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - mp_backend single <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - n_workers 1 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - n_learners 1 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - share_buffer 1 <class 'bool'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - online_eval 0 <class 'bool'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - online_eval_episode 10 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - model_save_fre 500 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - load_checkpoint 0 <class 'bool'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - load_path Train_single_CliffWalking-v0_QLearning_20230519-005837 <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - load_model_step 12000 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================ | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - Algo Configs: | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================ | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - Name Value Type | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - epsilon_start 0.95 <class 'float'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - epsilon_end 0.01 <class 'float'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - epsilon_decay 300 <class 'int'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - gamma 0.99 <class 'float'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - lr 0.1 <class 'float'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================ | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - Env Configs: | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================ | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - Name Value Type | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - id CliffWalking-v0 <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - render_mode None <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - wrapper None <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] <class 'str'> | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================ | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - obs_space: Discrete(48), n_actions: Discrete(4) | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - Start training! | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 0, ep_reward: -496, ep_step: 100 | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 1, ep_reward: -496, ep_step: 100 | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 2, ep_reward: -298, ep_step: 100 | |
| 2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 3, ep_reward: -298, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 4, ep_reward: -298, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 5, ep_reward: -298, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 6, ep_reward: -199, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 7, ep_reward: -73, ep_step: 73 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 8, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 9, ep_reward: -199, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 10, ep_reward: -199, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 11, ep_reward: -199, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 12, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 13, ep_reward: -71, ep_step: 71 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 14, ep_reward: -89, ep_step: 89 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 15, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 16, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 17, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 18, ep_reward: -81, ep_step: 81 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 19, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 20, ep_reward: -58, ep_step: 58 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 21, ep_reward: -185, ep_step: 86 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 22, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 23, ep_reward: -71, ep_step: 71 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 24, ep_reward: -97, ep_step: 97 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 25, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 26, ep_reward: -55, ep_step: 55 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 27, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 28, ep_reward: -98, ep_step: 98 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 29, ep_reward: -73, ep_step: 73 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 30, ep_reward: -74, ep_step: 74 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 31, ep_reward: -99, ep_step: 99 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 32, ep_reward: -85, ep_step: 85 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 33, ep_reward: -78, ep_step: 78 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 34, ep_reward: -98, ep_step: 98 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 35, ep_reward: -81, ep_step: 81 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 36, ep_reward: -57, ep_step: 57 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 37, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 38, ep_reward: -27, ep_step: 27 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 39, ep_reward: -63, ep_step: 63 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 40, ep_reward: -60, ep_step: 60 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 41, ep_reward: -75, ep_step: 75 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 42, ep_reward: -93, ep_step: 93 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 43, ep_reward: -60, ep_step: 60 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 44, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 45, ep_reward: -83, ep_step: 83 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 46, ep_reward: -70, ep_step: 70 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 47, ep_reward: -74, ep_step: 74 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 48, ep_reward: -86, ep_step: 86 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 49, ep_reward: -67, ep_step: 67 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 50, ep_reward: -93, ep_step: 93 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 51, ep_reward: -45, ep_step: 45 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 52, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 53, ep_reward: -75, ep_step: 75 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 54, ep_reward: -51, ep_step: 51 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 55, ep_reward: -55, ep_step: 55 | |
| 2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 56, ep_reward: -61, ep_step: 61 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 57, ep_reward: -74, ep_step: 74 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 58, ep_reward: -25, ep_step: 25 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 59, ep_reward: -100, ep_step: 100 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 60, ep_reward: -82, ep_step: 82 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 61, ep_reward: -42, ep_step: 42 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 62, ep_reward: -53, ep_step: 53 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 63, ep_reward: -48, ep_step: 48 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 64, ep_reward: -65, ep_step: 65 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 65, ep_reward: -91, ep_step: 91 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 66, ep_reward: -87, ep_step: 87 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 67, ep_reward: -20, ep_step: 20 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 68, ep_reward: -38, ep_step: 38 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 69, ep_reward: -75, ep_step: 75 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 70, ep_reward: -65, ep_step: 65 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 71, ep_reward: -61, ep_step: 61 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 72, ep_reward: -54, ep_step: 54 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 73, ep_reward: -47, ep_step: 47 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 74, ep_reward: -77, ep_step: 77 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 75, ep_reward: -48, ep_step: 48 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 76, ep_reward: -60, ep_step: 60 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 77, ep_reward: -50, ep_step: 50 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 78, ep_reward: -62, ep_step: 62 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 79, ep_reward: -40, ep_step: 40 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 80, ep_reward: -28, ep_step: 28 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 81, ep_reward: -64, ep_step: 64 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 82, ep_reward: -58, ep_step: 58 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 83, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 84, ep_reward: -56, ep_step: 56 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 85, ep_reward: -46, ep_step: 46 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 86, ep_reward: -50, ep_step: 50 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 87, ep_reward: -38, ep_step: 38 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 88, ep_reward: -46, ep_step: 46 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 89, ep_reward: -41, ep_step: 41 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 90, ep_reward: -43, ep_step: 43 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 91, ep_reward: -45, ep_step: 45 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 92, ep_reward: -61, ep_step: 61 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 93, ep_reward: -48, ep_step: 48 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 94, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 95, ep_reward: -28, ep_step: 28 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 96, ep_reward: -78, ep_step: 78 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 97, ep_reward: -33, ep_step: 33 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 98, ep_reward: -133, ep_step: 34 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 99, ep_reward: -48, ep_step: 48 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 100, ep_reward: -44, ep_step: 44 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 101, ep_reward: -31, ep_step: 31 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 102, ep_reward: -49, ep_step: 49 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 103, ep_reward: -39, ep_step: 39 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 104, ep_reward: -62, ep_step: 62 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 105, ep_reward: -42, ep_step: 42 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 106, ep_reward: -25, ep_step: 25 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 107, ep_reward: -30, ep_step: 30 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 108, ep_reward: -63, ep_step: 63 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 109, ep_reward: -16, ep_step: 16 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 110, ep_reward: -33, ep_step: 33 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 111, ep_reward: -45, ep_step: 45 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 112, ep_reward: -55, ep_step: 55 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 113, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 114, ep_reward: -35, ep_step: 35 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 115, ep_reward: -30, ep_step: 30 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 116, ep_reward: -51, ep_step: 51 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 117, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 118, ep_reward: -27, ep_step: 27 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 119, ep_reward: -28, ep_step: 28 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 120, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 121, ep_reward: -54, ep_step: 54 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 122, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 123, ep_reward: -40, ep_step: 40 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 124, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 125, ep_reward: -38, ep_step: 38 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 126, ep_reward: -40, ep_step: 40 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 127, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 128, ep_reward: -31, ep_step: 31 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 129, ep_reward: -73, ep_step: 73 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 130, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 131, ep_reward: -41, ep_step: 41 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 132, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 133, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 134, ep_reward: -48, ep_step: 48 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 135, ep_reward: -24, ep_step: 24 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 136, ep_reward: -32, ep_step: 32 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 137, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 138, ep_reward: -30, ep_step: 30 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 139, ep_reward: -32, ep_step: 32 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 140, ep_reward: -32, ep_step: 32 | |
| 2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 141, ep_reward: -32, ep_step: 32 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 142, ep_reward: -36, ep_step: 36 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 143, ep_reward: -17, ep_step: 17 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 144, ep_reward: -41, ep_step: 41 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 145, ep_reward: -132, ep_step: 33 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 146, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 147, ep_reward: -34, ep_step: 34 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 148, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 149, ep_reward: -29, ep_step: 29 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 150, ep_reward: -38, ep_step: 38 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 151, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 152, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 153, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 154, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 155, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 156, ep_reward: -33, ep_step: 33 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 157, ep_reward: -46, ep_step: 46 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 158, ep_reward: -29, ep_step: 29 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 159, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 160, ep_reward: -32, ep_step: 32 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 161, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 162, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 163, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 164, ep_reward: -25, ep_step: 25 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 165, ep_reward: -39, ep_step: 39 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 166, ep_reward: -27, ep_step: 27 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 167, ep_reward: -24, ep_step: 24 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 168, ep_reward: -14, ep_step: 14 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 169, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 170, ep_reward: -33, ep_step: 33 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 171, ep_reward: -34, ep_step: 34 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 172, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 173, ep_reward: -41, ep_step: 41 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 174, ep_reward: -20, ep_step: 20 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 175, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 176, ep_reward: -17, ep_step: 17 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 177, ep_reward: -24, ep_step: 24 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 178, ep_reward: -32, ep_step: 32 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 179, ep_reward: -16, ep_step: 16 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 180, ep_reward: -31, ep_step: 31 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 181, ep_reward: -17, ep_step: 17 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 182, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 183, ep_reward: -31, ep_step: 31 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 184, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 185, ep_reward: -40, ep_step: 40 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 186, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 187, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 188, ep_reward: -29, ep_step: 29 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 189, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 190, ep_reward: -49, ep_step: 49 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 191, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 192, ep_reward: -14, ep_step: 14 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 193, ep_reward: -33, ep_step: 33 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 194, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 195, ep_reward: -20, ep_step: 20 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 196, ep_reward: -27, ep_step: 27 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 197, ep_reward: -28, ep_step: 28 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 198, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 199, ep_reward: -37, ep_step: 37 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 200, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 201, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 202, ep_reward: -27, ep_step: 27 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 203, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 204, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 205, ep_reward: -24, ep_step: 24 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 206, ep_reward: -28, ep_step: 28 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 207, ep_reward: -18, ep_step: 18 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 208, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 209, ep_reward: -25, ep_step: 25 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 210, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 211, ep_reward: -16, ep_step: 16 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 212, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 213, ep_reward: -20, ep_step: 20 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 214, ep_reward: -31, ep_step: 31 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 215, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 216, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 217, ep_reward: -35, ep_step: 35 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 218, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 219, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 220, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 221, ep_reward: -29, ep_step: 29 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 222, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 223, ep_reward: -25, ep_step: 25 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 224, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 225, ep_reward: -26, ep_step: 26 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 226, ep_reward: -27, ep_step: 27 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 227, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 228, ep_reward: -17, ep_step: 17 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 229, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 230, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 231, ep_reward: -20, ep_step: 20 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 232, ep_reward: -28, ep_step: 28 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 233, ep_reward: -18, ep_step: 18 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 234, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 235, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 236, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 237, ep_reward: -30, ep_step: 30 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 238, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 239, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 240, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 241, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 242, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 243, ep_reward: -16, ep_step: 16 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 244, ep_reward: -18, ep_step: 18 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 245, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 246, ep_reward: -35, ep_step: 35 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 247, ep_reward: -18, ep_step: 18 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 248, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 249, ep_reward: -17, ep_step: 17 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 250, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 251, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 252, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 253, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 254, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 255, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 256, ep_reward: -18, ep_step: 18 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 257, ep_reward: -22, ep_step: 22 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 258, ep_reward: -25, ep_step: 25 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 259, ep_reward: -24, ep_step: 24 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 260, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 261, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 262, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 263, ep_reward: -17, ep_step: 17 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 264, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 265, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 266, ep_reward: -24, ep_step: 24 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 267, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 268, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 269, ep_reward: -27, ep_step: 27 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 270, ep_reward: -118, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 271, ep_reward: -20, ep_step: 20 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 272, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 273, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 274, ep_reward: -17, ep_step: 17 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 275, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 276, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 277, ep_reward: -14, ep_step: 14 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 278, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 279, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 280, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 281, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 282, ep_reward: -24, ep_step: 24 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 283, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 284, ep_reward: -25, ep_step: 25 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 285, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 286, ep_reward: -23, ep_step: 23 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 287, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 288, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 289, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 290, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 291, ep_reward: -18, ep_step: 18 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 292, ep_reward: -14, ep_step: 14 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 293, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 294, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 295, ep_reward: -15, ep_step: 15 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 296, ep_reward: -19, ep_step: 19 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 297, ep_reward: -16, ep_step: 16 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 298, ep_reward: -13, ep_step: 13 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 299, ep_reward: -21, ep_step: 21 | |
| 2023-05-19 01:08:07 - SimpleLog - INFO: - Finish training! total time consumed: 3.05s | |