johnjim0816
add all benchmarks
62e03a2
raw
history blame
76.7 kB
2022-11-28 15:29:49 - r - INFO: - Hyperparameters:
2022-11-28 15:29:49 - r - INFO: - ================================================================================
2022-11-28 15:29:49 - r - INFO: - Name Value Type
2022-11-28 15:29:49 - r - INFO: - env_name FrozenLakeNoSlippery-v1 <class 'str'>
2022-11-28 15:29:49 - r - INFO: - new_step_api 1 <class 'bool'>
2022-11-28 15:29:49 - r - INFO: - wrapper None <class 'str'>
2022-11-28 15:29:49 - r - INFO: - render 0 <class 'bool'>
2022-11-28 15:29:49 - r - INFO: - algo_name QLearning <class 'str'>
2022-11-28 15:29:49 - r - INFO: - mode train <class 'str'>
2022-11-28 15:29:49 - r - INFO: - seed 10 <class 'int'>
2022-11-28 15:29:49 - r - INFO: - device cpu <class 'str'>
2022-11-28 15:29:49 - r - INFO: - train_eps 800 <class 'int'>
2022-11-28 15:29:49 - r - INFO: - test_eps 20 <class 'int'>
2022-11-28 15:29:49 - r - INFO: - eval_eps 10 <class 'int'>
2022-11-28 15:29:49 - r - INFO: - eval_per_episode 5 <class 'int'>
2022-11-28 15:29:49 - r - INFO: - max_steps 200 <class 'int'>
2022-11-28 15:29:49 - r - INFO: - load_checkpoint 0 <class 'bool'>
2022-11-28 15:29:49 - r - INFO: - load_path Train_CartPole-v1_DQN_20221026-054757 <class 'str'>
2022-11-28 15:29:49 - r - INFO: - show_fig 0 <class 'bool'>
2022-11-28 15:29:49 - r - INFO: - save_fig 1 <class 'bool'>
2022-11-28 15:29:49 - r - INFO: - epsilon_start 0.7 <class 'float'>
2022-11-28 15:29:49 - r - INFO: - epsilon_end 0.1 <class 'float'>
2022-11-28 15:29:49 - r - INFO: - epsilon_decay 2000 <class 'int'>
2022-11-28 15:29:49 - r - INFO: - gamma 0.95 <class 'float'>
2022-11-28 15:29:49 - r - INFO: - lr 0.9 <class 'float'>
2022-11-28 15:29:49 - r - INFO: - ================================================================================
2022-11-28 15:29:50 - r - INFO: - n_states: 16, n_actions: 4
2022-11-28 15:29:50 - r - INFO: - Start training!
2022-11-28 15:29:50 - r - INFO: - Env: FrozenLakeNoSlippery-v1, Algorithm: QLearning, Device: cpu
2022-11-28 15:29:50 - r - INFO: - Episode: 1/800, Reward: 0.000, Step: 20
2022-11-28 15:29:50 - r - INFO: - Episode: 2/800, Reward: 0.000, Step: 14
2022-11-28 15:29:50 - r - INFO: - Episode: 3/800, Reward: 0.000, Step: 13
2022-11-28 15:29:50 - r - INFO: - Episode: 4/800, Reward: 0.000, Step: 9
2022-11-28 15:29:50 - r - INFO: - Episode: 5/800, Reward: 0.000, Step: 10
2022-11-28 15:29:50 - r - INFO: - Current episode 5 has the best eval reward: 0.000
2022-11-28 15:29:50 - r - INFO: - Episode: 6/800, Reward: 0.000, Step: 6
2022-11-28 15:29:50 - r - INFO: - Episode: 7/800, Reward: 0.000, Step: 11
2022-11-28 15:29:50 - r - INFO: - Episode: 8/800, Reward: 0.000, Step: 6
2022-11-28 15:29:50 - r - INFO: - Episode: 9/800, Reward: 0.000, Step: 3
2022-11-28 15:29:50 - r - INFO: - Episode: 10/800, Reward: 0.000, Step: 9
2022-11-28 15:29:50 - r - INFO: - Current episode 10 has the best eval reward: 0.000
2022-11-28 15:29:50 - r - INFO: - Episode: 11/800, Reward: 0.000, Step: 11
2022-11-28 15:29:50 - r - INFO: - Episode: 12/800, Reward: 0.000, Step: 22
2022-11-28 15:29:50 - r - INFO: - Episode: 13/800, Reward: 0.000, Step: 5
2022-11-28 15:29:50 - r - INFO: - Episode: 14/800, Reward: 0.000, Step: 16
2022-11-28 15:29:50 - r - INFO: - Episode: 15/800, Reward: 0.000, Step: 4
2022-11-28 15:29:50 - r - INFO: - Current episode 15 has the best eval reward: 0.000
2022-11-28 15:29:50 - r - INFO: - Episode: 16/800, Reward: 0.000, Step: 9
2022-11-28 15:29:50 - r - INFO: - Episode: 17/800, Reward: 0.000, Step: 18
2022-11-28 15:29:50 - r - INFO: - Episode: 18/800, Reward: 0.000, Step: 2
2022-11-28 15:29:50 - r - INFO: - Episode: 19/800, Reward: 0.000, Step: 4
2022-11-28 15:29:50 - r - INFO: - Episode: 20/800, Reward: 0.000, Step: 8
2022-11-28 15:29:50 - r - INFO: - Current episode 20 has the best eval reward: 0.000
2022-11-28 15:29:50 - r - INFO: - Episode: 21/800, Reward: 0.000, Step: 7
2022-11-28 15:29:50 - r - INFO: - Episode: 22/800, Reward: 0.000, Step: 4
2022-11-28 15:29:50 - r - INFO: - Episode: 23/800, Reward: 0.000, Step: 22
2022-11-28 15:29:50 - r - INFO: - Episode: 24/800, Reward: 0.000, Step: 15
2022-11-28 15:29:50 - r - INFO: - Episode: 25/800, Reward: 0.000, Step: 5
2022-11-28 15:29:50 - r - INFO: - Current episode 25 has the best eval reward: 0.000
2022-11-28 15:29:50 - r - INFO: - Episode: 26/800, Reward: 0.000, Step: 16
2022-11-28 15:29:50 - r - INFO: - Episode: 27/800, Reward: 0.000, Step: 7
2022-11-28 15:29:50 - r - INFO: - Episode: 28/800, Reward: 0.000, Step: 19
2022-11-28 15:29:50 - r - INFO: - Episode: 29/800, Reward: 0.000, Step: 22
2022-11-28 15:29:50 - r - INFO: - Episode: 30/800, Reward: 0.000, Step: 16
2022-11-28 15:29:50 - r - INFO: - Current episode 30 has the best eval reward: 0.000
2022-11-28 15:29:50 - r - INFO: - Episode: 31/800, Reward: 0.000, Step: 11
2022-11-28 15:29:50 - r - INFO: - Episode: 32/800, Reward: 0.000, Step: 22
2022-11-28 15:29:50 - r - INFO: - Episode: 33/800, Reward: 0.000, Step: 28
2022-11-28 15:29:50 - r - INFO: - Episode: 34/800, Reward: 0.000, Step: 23
2022-11-28 15:29:50 - r - INFO: - Episode: 35/800, Reward: 0.000, Step: 4
2022-11-28 15:29:51 - r - INFO: - Current episode 35 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 36/800, Reward: 0.000, Step: 11
2022-11-28 15:29:51 - r - INFO: - Episode: 37/800, Reward: 0.000, Step: 8
2022-11-28 15:29:51 - r - INFO: - Episode: 38/800, Reward: 0.000, Step: 15
2022-11-28 15:29:51 - r - INFO: - Episode: 39/800, Reward: 0.000, Step: 5
2022-11-28 15:29:51 - r - INFO: - Episode: 40/800, Reward: 0.000, Step: 7
2022-11-28 15:29:51 - r - INFO: - Current episode 40 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 41/800, Reward: 0.000, Step: 9
2022-11-28 15:29:51 - r - INFO: - Episode: 42/800, Reward: 0.000, Step: 4
2022-11-28 15:29:51 - r - INFO: - Episode: 43/800, Reward: 0.000, Step: 3
2022-11-28 15:29:51 - r - INFO: - Episode: 44/800, Reward: 0.000, Step: 6
2022-11-28 15:29:51 - r - INFO: - Episode: 45/800, Reward: 0.000, Step: 41
2022-11-28 15:29:51 - r - INFO: - Current episode 45 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 46/800, Reward: 0.000, Step: 9
2022-11-28 15:29:51 - r - INFO: - Episode: 47/800, Reward: 0.000, Step: 23
2022-11-28 15:29:51 - r - INFO: - Episode: 48/800, Reward: 0.000, Step: 3
2022-11-28 15:29:51 - r - INFO: - Episode: 49/800, Reward: 1.000, Step: 38
2022-11-28 15:29:51 - r - INFO: - Episode: 50/800, Reward: 0.000, Step: 29
2022-11-28 15:29:51 - r - INFO: - Current episode 50 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 51/800, Reward: 0.000, Step: 17
2022-11-28 15:29:51 - r - INFO: - Episode: 52/800, Reward: 0.000, Step: 4
2022-11-28 15:29:51 - r - INFO: - Episode: 53/800, Reward: 0.000, Step: 2
2022-11-28 15:29:51 - r - INFO: - Episode: 54/800, Reward: 0.000, Step: 25
2022-11-28 15:29:51 - r - INFO: - Episode: 55/800, Reward: 0.000, Step: 6
2022-11-28 15:29:51 - r - INFO: - Current episode 55 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 56/800, Reward: 0.000, Step: 2
2022-11-28 15:29:51 - r - INFO: - Episode: 57/800, Reward: 0.000, Step: 30
2022-11-28 15:29:51 - r - INFO: - Episode: 58/800, Reward: 0.000, Step: 6
2022-11-28 15:29:51 - r - INFO: - Episode: 59/800, Reward: 0.000, Step: 7
2022-11-28 15:29:51 - r - INFO: - Episode: 60/800, Reward: 0.000, Step: 11
2022-11-28 15:29:51 - r - INFO: - Current episode 60 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 61/800, Reward: 0.000, Step: 9
2022-11-28 15:29:51 - r - INFO: - Episode: 62/800, Reward: 0.000, Step: 8
2022-11-28 15:29:51 - r - INFO: - Episode: 63/800, Reward: 0.000, Step: 23
2022-11-28 15:29:51 - r - INFO: - Episode: 64/800, Reward: 0.000, Step: 10
2022-11-28 15:29:51 - r - INFO: - Episode: 65/800, Reward: 0.000, Step: 3
2022-11-28 15:29:51 - r - INFO: - Current episode 65 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 66/800, Reward: 0.000, Step: 5
2022-11-28 15:29:51 - r - INFO: - Episode: 67/800, Reward: 0.000, Step: 7
2022-11-28 15:29:51 - r - INFO: - Episode: 68/800, Reward: 0.000, Step: 18
2022-11-28 15:29:51 - r - INFO: - Episode: 69/800, Reward: 0.000, Step: 8
2022-11-28 15:29:51 - r - INFO: - Episode: 70/800, Reward: 0.000, Step: 26
2022-11-28 15:29:51 - r - INFO: - Current episode 70 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 71/800, Reward: 0.000, Step: 6
2022-11-28 15:29:51 - r - INFO: - Episode: 72/800, Reward: 0.000, Step: 14
2022-11-28 15:29:51 - r - INFO: - Episode: 73/800, Reward: 0.000, Step: 4
2022-11-28 15:29:51 - r - INFO: - Episode: 74/800, Reward: 0.000, Step: 25
2022-11-28 15:29:51 - r - INFO: - Episode: 75/800, Reward: 0.000, Step: 21
2022-11-28 15:29:51 - r - INFO: - Current episode 75 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 76/800, Reward: 0.000, Step: 13
2022-11-28 15:29:51 - r - INFO: - Episode: 77/800, Reward: 0.000, Step: 4
2022-11-28 15:29:51 - r - INFO: - Episode: 78/800, Reward: 0.000, Step: 29
2022-11-28 15:29:51 - r - INFO: - Episode: 79/800, Reward: 0.000, Step: 21
2022-11-28 15:29:51 - r - INFO: - Episode: 80/800, Reward: 0.000, Step: 6
2022-11-28 15:29:51 - r - INFO: - Current episode 80 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 81/800, Reward: 0.000, Step: 6
2022-11-28 15:29:51 - r - INFO: - Episode: 82/800, Reward: 0.000, Step: 11
2022-11-28 15:29:51 - r - INFO: - Episode: 83/800, Reward: 0.000, Step: 21
2022-11-28 15:29:51 - r - INFO: - Episode: 84/800, Reward: 0.000, Step: 9
2022-11-28 15:29:51 - r - INFO: - Episode: 85/800, Reward: 0.000, Step: 9
2022-11-28 15:29:51 - r - INFO: - Current episode 85 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 86/800, Reward: 0.000, Step: 7
2022-11-28 15:29:51 - r - INFO: - Episode: 87/800, Reward: 0.000, Step: 48
2022-11-28 15:29:51 - r - INFO: - Episode: 88/800, Reward: 0.000, Step: 23
2022-11-28 15:29:51 - r - INFO: - Episode: 89/800, Reward: 0.000, Step: 160
2022-11-28 15:29:51 - r - INFO: - Episode: 90/800, Reward: 0.000, Step: 7
2022-11-28 15:29:51 - r - INFO: - Current episode 90 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 91/800, Reward: 0.000, Step: 10
2022-11-28 15:29:51 - r - INFO: - Episode: 92/800, Reward: 0.000, Step: 24
2022-11-28 15:29:51 - r - INFO: - Episode: 93/800, Reward: 0.000, Step: 4
2022-11-28 15:29:51 - r - INFO: - Episode: 94/800, Reward: 0.000, Step: 7
2022-11-28 15:29:51 - r - INFO: - Episode: 95/800, Reward: 0.000, Step: 17
2022-11-28 15:29:51 - r - INFO: - Current episode 95 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 96/800, Reward: 0.000, Step: 87
2022-11-28 15:29:51 - r - INFO: - Episode: 97/800, Reward: 0.000, Step: 28
2022-11-28 15:29:51 - r - INFO: - Episode: 98/800, Reward: 0.000, Step: 7
2022-11-28 15:29:51 - r - INFO: - Episode: 99/800, Reward: 0.000, Step: 5
2022-11-28 15:29:51 - r - INFO: - Episode: 100/800, Reward: 0.000, Step: 12
2022-11-28 15:29:51 - r - INFO: - Current episode 100 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 101/800, Reward: 0.000, Step: 14
2022-11-28 15:29:51 - r - INFO: - Episode: 102/800, Reward: 0.000, Step: 6
2022-11-28 15:29:51 - r - INFO: - Episode: 103/800, Reward: 0.000, Step: 13
2022-11-28 15:29:51 - r - INFO: - Episode: 104/800, Reward: 0.000, Step: 93
2022-11-28 15:29:51 - r - INFO: - Episode: 105/800, Reward: 0.000, Step: 4
2022-11-28 15:29:51 - r - INFO: - Current episode 105 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 106/800, Reward: 0.000, Step: 50
2022-11-28 15:29:51 - r - INFO: - Episode: 107/800, Reward: 0.000, Step: 8
2022-11-28 15:29:51 - r - INFO: - Episode: 108/800, Reward: 0.000, Step: 12
2022-11-28 15:29:51 - r - INFO: - Episode: 109/800, Reward: 0.000, Step: 43
2022-11-28 15:29:51 - r - INFO: - Episode: 110/800, Reward: 0.000, Step: 30
2022-11-28 15:29:51 - r - INFO: - Current episode 110 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 111/800, Reward: 0.000, Step: 15
2022-11-28 15:29:51 - r - INFO: - Episode: 112/800, Reward: 0.000, Step: 19
2022-11-28 15:29:51 - r - INFO: - Episode: 113/800, Reward: 0.000, Step: 182
2022-11-28 15:29:51 - r - INFO: - Episode: 114/800, Reward: 0.000, Step: 40
2022-11-28 15:29:51 - r - INFO: - Episode: 115/800, Reward: 0.000, Step: 88
2022-11-28 15:29:51 - r - INFO: - Current episode 115 has the best eval reward: 0.000
2022-11-28 15:29:51 - r - INFO: - Episode: 116/800, Reward: 0.000, Step: 19
2022-11-28 15:29:51 - r - INFO: - Episode: 117/800, Reward: 0.000, Step: 30
2022-11-28 15:29:51 - r - INFO: - Episode: 118/800, Reward: 0.000, Step: 27
2022-11-28 15:29:51 - r - INFO: - Episode: 119/800, Reward: 0.000, Step: 5
2022-11-28 15:29:51 - r - INFO: - Episode: 120/800, Reward: 0.000, Step: 87
2022-11-28 15:29:52 - r - INFO: - Current episode 120 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 121/800, Reward: 0.000, Step: 9
2022-11-28 15:29:52 - r - INFO: - Episode: 122/800, Reward: 0.000, Step: 64
2022-11-28 15:29:52 - r - INFO: - Episode: 123/800, Reward: 0.000, Step: 27
2022-11-28 15:29:52 - r - INFO: - Episode: 124/800, Reward: 0.000, Step: 68
2022-11-28 15:29:52 - r - INFO: - Episode: 125/800, Reward: 0.000, Step: 81
2022-11-28 15:29:52 - r - INFO: - Current episode 125 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 126/800, Reward: 0.000, Step: 86
2022-11-28 15:29:52 - r - INFO: - Episode: 127/800, Reward: 0.000, Step: 200
2022-11-28 15:29:52 - r - INFO: - Episode: 128/800, Reward: 0.000, Step: 27
2022-11-28 15:29:52 - r - INFO: - Episode: 129/800, Reward: 0.000, Step: 41
2022-11-28 15:29:52 - r - INFO: - Episode: 130/800, Reward: 0.000, Step: 70
2022-11-28 15:29:52 - r - INFO: - Current episode 130 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 131/800, Reward: 0.000, Step: 27
2022-11-28 15:29:52 - r - INFO: - Episode: 132/800, Reward: 0.000, Step: 6
2022-11-28 15:29:52 - r - INFO: - Episode: 133/800, Reward: 0.000, Step: 18
2022-11-28 15:29:52 - r - INFO: - Episode: 134/800, Reward: 0.000, Step: 38
2022-11-28 15:29:52 - r - INFO: - Episode: 135/800, Reward: 0.000, Step: 26
2022-11-28 15:29:52 - r - INFO: - Current episode 135 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 136/800, Reward: 0.000, Step: 36
2022-11-28 15:29:52 - r - INFO: - Episode: 137/800, Reward: 0.000, Step: 3
2022-11-28 15:29:52 - r - INFO: - Episode: 138/800, Reward: 0.000, Step: 61
2022-11-28 15:29:52 - r - INFO: - Episode: 139/800, Reward: 0.000, Step: 105
2022-11-28 15:29:52 - r - INFO: - Episode: 140/800, Reward: 0.000, Step: 38
2022-11-28 15:29:52 - r - INFO: - Current episode 140 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 141/800, Reward: 0.000, Step: 18
2022-11-28 15:29:52 - r - INFO: - Episode: 142/800, Reward: 0.000, Step: 33
2022-11-28 15:29:52 - r - INFO: - Episode: 143/800, Reward: 0.000, Step: 29
2022-11-28 15:29:52 - r - INFO: - Episode: 144/800, Reward: 0.000, Step: 49
2022-11-28 15:29:52 - r - INFO: - Episode: 145/800, Reward: 0.000, Step: 88
2022-11-28 15:29:52 - r - INFO: - Current episode 145 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 146/800, Reward: 0.000, Step: 22
2022-11-28 15:29:52 - r - INFO: - Episode: 147/800, Reward: 0.000, Step: 65
2022-11-28 15:29:52 - r - INFO: - Episode: 148/800, Reward: 0.000, Step: 36
2022-11-28 15:29:52 - r - INFO: - Episode: 149/800, Reward: 0.000, Step: 30
2022-11-28 15:29:52 - r - INFO: - Episode: 150/800, Reward: 0.000, Step: 58
2022-11-28 15:29:52 - r - INFO: - Current episode 150 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 151/800, Reward: 0.000, Step: 43
2022-11-28 15:29:52 - r - INFO: - Episode: 152/800, Reward: 0.000, Step: 53
2022-11-28 15:29:52 - r - INFO: - Episode: 153/800, Reward: 0.000, Step: 43
2022-11-28 15:29:52 - r - INFO: - Episode: 154/800, Reward: 0.000, Step: 13
2022-11-28 15:29:52 - r - INFO: - Episode: 155/800, Reward: 0.000, Step: 8
2022-11-28 15:29:52 - r - INFO: - Current episode 155 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 156/800, Reward: 0.000, Step: 39
2022-11-28 15:29:52 - r - INFO: - Episode: 157/800, Reward: 0.000, Step: 29
2022-11-28 15:29:52 - r - INFO: - Episode: 158/800, Reward: 0.000, Step: 26
2022-11-28 15:29:52 - r - INFO: - Episode: 159/800, Reward: 0.000, Step: 60
2022-11-28 15:29:52 - r - INFO: - Episode: 160/800, Reward: 0.000, Step: 153
2022-11-28 15:29:52 - r - INFO: - Current episode 160 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 161/800, Reward: 0.000, Step: 116
2022-11-28 15:29:52 - r - INFO: - Episode: 162/800, Reward: 0.000, Step: 53
2022-11-28 15:29:52 - r - INFO: - Episode: 163/800, Reward: 0.000, Step: 54
2022-11-28 15:29:52 - r - INFO: - Episode: 164/800, Reward: 0.000, Step: 8
2022-11-28 15:29:52 - r - INFO: - Episode: 165/800, Reward: 0.000, Step: 58
2022-11-28 15:29:52 - r - INFO: - Current episode 165 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 166/800, Reward: 0.000, Step: 3
2022-11-28 15:29:52 - r - INFO: - Episode: 167/800, Reward: 0.000, Step: 47
2022-11-28 15:29:52 - r - INFO: - Episode: 168/800, Reward: 0.000, Step: 16
2022-11-28 15:29:52 - r - INFO: - Episode: 169/800, Reward: 0.000, Step: 21
2022-11-28 15:29:52 - r - INFO: - Episode: 170/800, Reward: 0.000, Step: 44
2022-11-28 15:29:52 - r - INFO: - Current episode 170 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 171/800, Reward: 0.000, Step: 29
2022-11-28 15:29:52 - r - INFO: - Episode: 172/800, Reward: 0.000, Step: 104
2022-11-28 15:29:52 - r - INFO: - Episode: 173/800, Reward: 0.000, Step: 158
2022-11-28 15:29:52 - r - INFO: - Episode: 174/800, Reward: 0.000, Step: 83
2022-11-28 15:29:52 - r - INFO: - Episode: 175/800, Reward: 0.000, Step: 26
2022-11-28 15:29:52 - r - INFO: - Current episode 175 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 176/800, Reward: 0.000, Step: 24
2022-11-28 15:29:52 - r - INFO: - Episode: 177/800, Reward: 0.000, Step: 10
2022-11-28 15:29:52 - r - INFO: - Episode: 178/800, Reward: 0.000, Step: 12
2022-11-28 15:29:52 - r - INFO: - Episode: 179/800, Reward: 0.000, Step: 40
2022-11-28 15:29:52 - r - INFO: - Episode: 180/800, Reward: 0.000, Step: 25
2022-11-28 15:29:52 - r - INFO: - Current episode 180 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 181/800, Reward: 0.000, Step: 18
2022-11-28 15:29:52 - r - INFO: - Episode: 182/800, Reward: 0.000, Step: 60
2022-11-28 15:29:52 - r - INFO: - Episode: 183/800, Reward: 0.000, Step: 200
2022-11-28 15:29:52 - r - INFO: - Episode: 184/800, Reward: 0.000, Step: 24
2022-11-28 15:29:52 - r - INFO: - Episode: 185/800, Reward: 0.000, Step: 56
2022-11-28 15:29:52 - r - INFO: - Current episode 185 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 186/800, Reward: 0.000, Step: 71
2022-11-28 15:29:52 - r - INFO: - Episode: 187/800, Reward: 0.000, Step: 19
2022-11-28 15:29:52 - r - INFO: - Episode: 188/800, Reward: 0.000, Step: 118
2022-11-28 15:29:52 - r - INFO: - Episode: 189/800, Reward: 0.000, Step: 26
2022-11-28 15:29:52 - r - INFO: - Episode: 190/800, Reward: 0.000, Step: 41
2022-11-28 15:29:52 - r - INFO: - Current episode 190 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 191/800, Reward: 0.000, Step: 41
2022-11-28 15:29:52 - r - INFO: - Episode: 192/800, Reward: 0.000, Step: 60
2022-11-28 15:29:52 - r - INFO: - Episode: 193/800, Reward: 0.000, Step: 31
2022-11-28 15:29:52 - r - INFO: - Episode: 194/800, Reward: 0.000, Step: 34
2022-11-28 15:29:52 - r - INFO: - Episode: 195/800, Reward: 0.000, Step: 35
2022-11-28 15:29:52 - r - INFO: - Current episode 195 has the best eval reward: 0.000
2022-11-28 15:29:52 - r - INFO: - Episode: 196/800, Reward: 0.000, Step: 59
2022-11-28 15:29:52 - r - INFO: - Episode: 197/800, Reward: 0.000, Step: 51
2022-11-28 15:29:52 - r - INFO: - Episode: 198/800, Reward: 0.000, Step: 200
2022-11-28 15:29:52 - r - INFO: - Episode: 199/800, Reward: 0.000, Step: 200
2022-11-28 15:29:52 - r - INFO: - Episode: 200/800, Reward: 0.000, Step: 37
2022-11-28 15:29:53 - r - INFO: - Current episode 200 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 201/800, Reward: 0.000, Step: 68
2022-11-28 15:29:53 - r - INFO: - Episode: 202/800, Reward: 0.000, Step: 40
2022-11-28 15:29:53 - r - INFO: - Episode: 203/800, Reward: 0.000, Step: 17
2022-11-28 15:29:53 - r - INFO: - Episode: 204/800, Reward: 0.000, Step: 79
2022-11-28 15:29:53 - r - INFO: - Episode: 205/800, Reward: 0.000, Step: 126
2022-11-28 15:29:53 - r - INFO: - Current episode 205 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 206/800, Reward: 0.000, Step: 61
2022-11-28 15:29:53 - r - INFO: - Episode: 207/800, Reward: 0.000, Step: 25
2022-11-28 15:29:53 - r - INFO: - Episode: 208/800, Reward: 0.000, Step: 18
2022-11-28 15:29:53 - r - INFO: - Episode: 209/800, Reward: 0.000, Step: 27
2022-11-28 15:29:53 - r - INFO: - Episode: 210/800, Reward: 0.000, Step: 13
2022-11-28 15:29:53 - r - INFO: - Current episode 210 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 211/800, Reward: 0.000, Step: 187
2022-11-28 15:29:53 - r - INFO: - Episode: 212/800, Reward: 0.000, Step: 160
2022-11-28 15:29:53 - r - INFO: - Episode: 213/800, Reward: 0.000, Step: 32
2022-11-28 15:29:53 - r - INFO: - Episode: 214/800, Reward: 0.000, Step: 108
2022-11-28 15:29:53 - r - INFO: - Episode: 215/800, Reward: 0.000, Step: 164
2022-11-28 15:29:53 - r - INFO: - Current episode 215 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 216/800, Reward: 0.000, Step: 17
2022-11-28 15:29:53 - r - INFO: - Episode: 217/800, Reward: 0.000, Step: 82
2022-11-28 15:29:53 - r - INFO: - Episode: 218/800, Reward: 0.000, Step: 194
2022-11-28 15:29:53 - r - INFO: - Episode: 219/800, Reward: 0.000, Step: 7
2022-11-28 15:29:53 - r - INFO: - Episode: 220/800, Reward: 0.000, Step: 36
2022-11-28 15:29:53 - r - INFO: - Current episode 220 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 221/800, Reward: 0.000, Step: 156
2022-11-28 15:29:53 - r - INFO: - Episode: 222/800, Reward: 0.000, Step: 17
2022-11-28 15:29:53 - r - INFO: - Episode: 223/800, Reward: 0.000, Step: 183
2022-11-28 15:29:53 - r - INFO: - Episode: 224/800, Reward: 0.000, Step: 200
2022-11-28 15:29:53 - r - INFO: - Episode: 225/800, Reward: 0.000, Step: 43
2022-11-28 15:29:53 - r - INFO: - Current episode 225 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 226/800, Reward: 0.000, Step: 87
2022-11-28 15:29:53 - r - INFO: - Episode: 227/800, Reward: 0.000, Step: 42
2022-11-28 15:29:53 - r - INFO: - Episode: 228/800, Reward: 0.000, Step: 80
2022-11-28 15:29:53 - r - INFO: - Episode: 229/800, Reward: 0.000, Step: 54
2022-11-28 15:29:53 - r - INFO: - Episode: 230/800, Reward: 0.000, Step: 82
2022-11-28 15:29:53 - r - INFO: - Current episode 230 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 231/800, Reward: 0.000, Step: 97
2022-11-28 15:29:53 - r - INFO: - Episode: 232/800, Reward: 0.000, Step: 65
2022-11-28 15:29:53 - r - INFO: - Episode: 233/800, Reward: 0.000, Step: 83
2022-11-28 15:29:53 - r - INFO: - Episode: 234/800, Reward: 0.000, Step: 159
2022-11-28 15:29:53 - r - INFO: - Episode: 235/800, Reward: 0.000, Step: 178
2022-11-28 15:29:53 - r - INFO: - Current episode 235 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 236/800, Reward: 0.000, Step: 104
2022-11-28 15:29:53 - r - INFO: - Episode: 237/800, Reward: 0.000, Step: 21
2022-11-28 15:29:53 - r - INFO: - Episode: 238/800, Reward: 0.000, Step: 118
2022-11-28 15:29:53 - r - INFO: - Episode: 239/800, Reward: 0.000, Step: 80
2022-11-28 15:29:53 - r - INFO: - Episode: 240/800, Reward: 0.000, Step: 170
2022-11-28 15:29:53 - r - INFO: - Current episode 240 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 241/800, Reward: 0.000, Step: 94
2022-11-28 15:29:53 - r - INFO: - Episode: 242/800, Reward: 0.000, Step: 200
2022-11-28 15:29:53 - r - INFO: - Episode: 243/800, Reward: 0.000, Step: 37
2022-11-28 15:29:53 - r - INFO: - Episode: 244/800, Reward: 0.000, Step: 11
2022-11-28 15:29:53 - r - INFO: - Episode: 245/800, Reward: 0.000, Step: 31
2022-11-28 15:29:53 - r - INFO: - Current episode 245 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 246/800, Reward: 0.000, Step: 134
2022-11-28 15:29:53 - r - INFO: - Episode: 247/800, Reward: 0.000, Step: 32
2022-11-28 15:29:53 - r - INFO: - Episode: 248/800, Reward: 0.000, Step: 58
2022-11-28 15:29:53 - r - INFO: - Episode: 249/800, Reward: 0.000, Step: 38
2022-11-28 15:29:53 - r - INFO: - Episode: 250/800, Reward: 0.000, Step: 28
2022-11-28 15:29:53 - r - INFO: - Current episode 250 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 251/800, Reward: 0.000, Step: 159
2022-11-28 15:29:53 - r - INFO: - Episode: 252/800, Reward: 0.000, Step: 182
2022-11-28 15:29:53 - r - INFO: - Episode: 253/800, Reward: 0.000, Step: 51
2022-11-28 15:29:53 - r - INFO: - Episode: 254/800, Reward: 0.000, Step: 25
2022-11-28 15:29:53 - r - INFO: - Episode: 255/800, Reward: 0.000, Step: 73
2022-11-28 15:29:53 - r - INFO: - Current episode 255 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 256/800, Reward: 0.000, Step: 56
2022-11-28 15:29:53 - r - INFO: - Episode: 257/800, Reward: 0.000, Step: 55
2022-11-28 15:29:53 - r - INFO: - Episode: 258/800, Reward: 0.000, Step: 38
2022-11-28 15:29:53 - r - INFO: - Episode: 259/800, Reward: 0.000, Step: 200
2022-11-28 15:29:53 - r - INFO: - Episode: 260/800, Reward: 0.000, Step: 92
2022-11-28 15:29:53 - r - INFO: - Current episode 260 has the best eval reward: 0.000
2022-11-28 15:29:53 - r - INFO: - Episode: 261/800, Reward: 0.000, Step: 200
2022-11-28 15:29:53 - r - INFO: - Episode: 262/800, Reward: 0.000, Step: 119
2022-11-28 15:29:53 - r - INFO: - Episode: 263/800, Reward: 0.000, Step: 100
2022-11-28 15:29:53 - r - INFO: - Episode: 264/800, Reward: 0.000, Step: 84
2022-11-28 15:29:53 - r - INFO: - Episode: 265/800, Reward: 0.000, Step: 24
2022-11-28 15:29:54 - r - INFO: - Current episode 265 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 266/800, Reward: 0.000, Step: 17
2022-11-28 15:29:54 - r - INFO: - Episode: 267/800, Reward: 0.000, Step: 159
2022-11-28 15:29:54 - r - INFO: - Episode: 268/800, Reward: 0.000, Step: 25
2022-11-28 15:29:54 - r - INFO: - Episode: 269/800, Reward: 0.000, Step: 73
2022-11-28 15:29:54 - r - INFO: - Episode: 270/800, Reward: 0.000, Step: 130
2022-11-28 15:29:54 - r - INFO: - Current episode 270 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 271/800, Reward: 0.000, Step: 111
2022-11-28 15:29:54 - r - INFO: - Episode: 272/800, Reward: 0.000, Step: 65
2022-11-28 15:29:54 - r - INFO: - Episode: 273/800, Reward: 1.000, Step: 58
2022-11-28 15:29:54 - r - INFO: - Episode: 274/800, Reward: 0.000, Step: 47
2022-11-28 15:29:54 - r - INFO: - Episode: 275/800, Reward: 0.000, Step: 48
2022-11-28 15:29:54 - r - INFO: - Current episode 275 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 276/800, Reward: 0.000, Step: 13
2022-11-28 15:29:54 - r - INFO: - Episode: 277/800, Reward: 0.000, Step: 100
2022-11-28 15:29:54 - r - INFO: - Episode: 278/800, Reward: 0.000, Step: 38
2022-11-28 15:29:54 - r - INFO: - Episode: 279/800, Reward: 0.000, Step: 111
2022-11-28 15:29:54 - r - INFO: - Episode: 280/800, Reward: 0.000, Step: 200
2022-11-28 15:29:54 - r - INFO: - Current episode 280 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 281/800, Reward: 0.000, Step: 26
2022-11-28 15:29:54 - r - INFO: - Episode: 282/800, Reward: 0.000, Step: 38
2022-11-28 15:29:54 - r - INFO: - Episode: 283/800, Reward: 0.000, Step: 83
2022-11-28 15:29:54 - r - INFO: - Episode: 284/800, Reward: 0.000, Step: 42
2022-11-28 15:29:54 - r - INFO: - Episode: 285/800, Reward: 0.000, Step: 199
2022-11-28 15:29:54 - r - INFO: - Current episode 285 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 286/800, Reward: 0.000, Step: 83
2022-11-28 15:29:54 - r - INFO: - Episode: 287/800, Reward: 0.000, Step: 28
2022-11-28 15:29:54 - r - INFO: - Episode: 288/800, Reward: 0.000, Step: 46
2022-11-28 15:29:54 - r - INFO: - Episode: 289/800, Reward: 0.000, Step: 200
2022-11-28 15:29:54 - r - INFO: - Episode: 290/800, Reward: 0.000, Step: 62
2022-11-28 15:29:54 - r - INFO: - Current episode 290 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 291/800, Reward: 0.000, Step: 123
2022-11-28 15:29:54 - r - INFO: - Episode: 292/800, Reward: 0.000, Step: 91
2022-11-28 15:29:54 - r - INFO: - Episode: 293/800, Reward: 0.000, Step: 53
2022-11-28 15:29:54 - r - INFO: - Episode: 294/800, Reward: 0.000, Step: 19
2022-11-28 15:29:54 - r - INFO: - Episode: 295/800, Reward: 0.000, Step: 26
2022-11-28 15:29:54 - r - INFO: - Current episode 295 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 296/800, Reward: 0.000, Step: 93
2022-11-28 15:29:54 - r - INFO: - Episode: 297/800, Reward: 0.000, Step: 38
2022-11-28 15:29:54 - r - INFO: - Episode: 298/800, Reward: 0.000, Step: 22
2022-11-28 15:29:54 - r - INFO: - Episode: 299/800, Reward: 0.000, Step: 43
2022-11-28 15:29:54 - r - INFO: - Episode: 300/800, Reward: 0.000, Step: 163
2022-11-28 15:29:54 - r - INFO: - Current episode 300 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 301/800, Reward: 0.000, Step: 25
2022-11-28 15:29:54 - r - INFO: - Episode: 302/800, Reward: 0.000, Step: 59
2022-11-28 15:29:54 - r - INFO: - Episode: 303/800, Reward: 0.000, Step: 71
2022-11-28 15:29:54 - r - INFO: - Episode: 304/800, Reward: 0.000, Step: 20
2022-11-28 15:29:54 - r - INFO: - Episode: 305/800, Reward: 0.000, Step: 115
2022-11-28 15:29:54 - r - INFO: - Current episode 305 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 306/800, Reward: 0.000, Step: 200
2022-11-28 15:29:54 - r - INFO: - Episode: 307/800, Reward: 0.000, Step: 48
2022-11-28 15:29:54 - r - INFO: - Episode: 308/800, Reward: 0.000, Step: 66
2022-11-28 15:29:54 - r - INFO: - Episode: 309/800, Reward: 0.000, Step: 58
2022-11-28 15:29:54 - r - INFO: - Episode: 310/800, Reward: 0.000, Step: 129
2022-11-28 15:29:54 - r - INFO: - Current episode 310 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 311/800, Reward: 0.000, Step: 122
2022-11-28 15:29:54 - r - INFO: - Episode: 312/800, Reward: 0.000, Step: 47
2022-11-28 15:29:54 - r - INFO: - Episode: 313/800, Reward: 0.000, Step: 60
2022-11-28 15:29:54 - r - INFO: - Episode: 314/800, Reward: 0.000, Step: 79
2022-11-28 15:29:54 - r - INFO: - Episode: 315/800, Reward: 1.000, Step: 137
2022-11-28 15:29:54 - r - INFO: - Current episode 315 has the best eval reward: 0.000
2022-11-28 15:29:54 - r - INFO: - Episode: 316/800, Reward: 0.000, Step: 27
2022-11-28 15:29:54 - r - INFO: - Episode: 317/800, Reward: 1.000, Step: 93
2022-11-28 15:29:54 - r - INFO: - Episode: 318/800, Reward: 0.000, Step: 46
2022-11-28 15:29:54 - r - INFO: - Episode: 319/800, Reward: 1.000, Step: 83
2022-11-28 15:29:54 - r - INFO: - Episode: 320/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Current episode 320 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 321/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 322/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 323/800, Reward: 0.000, Step: 4
2022-11-28 15:29:54 - r - INFO: - Episode: 324/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 325/800, Reward: 0.000, Step: 2
2022-11-28 15:29:54 - r - INFO: - Current episode 325 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 326/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 327/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 328/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 329/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 330/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Current episode 330 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 331/800, Reward: 0.000, Step: 5
2022-11-28 15:29:54 - r - INFO: - Episode: 332/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 333/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 334/800, Reward: 0.000, Step: 5
2022-11-28 15:29:54 - r - INFO: - Episode: 335/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 335 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 336/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 337/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Episode: 338/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 339/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 340/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 340 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 341/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 342/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 343/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 344/800, Reward: 0.000, Step: 3
2022-11-28 15:29:54 - r - INFO: - Episode: 345/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Current episode 345 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 346/800, Reward: 0.000, Step: 4
2022-11-28 15:29:54 - r - INFO: - Episode: 347/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 348/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 349/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 350/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 350 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 351/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 352/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 353/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 354/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 355/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 355 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 356/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 357/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 358/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 359/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 360/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 360 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 361/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 362/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 363/800, Reward: 0.000, Step: 4
2022-11-28 15:29:54 - r - INFO: - Episode: 364/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Episode: 365/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Current episode 365 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 366/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 367/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 368/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Episode: 369/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 370/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 370 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 371/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 372/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 373/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 374/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Episode: 375/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Current episode 375 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 376/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 377/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 378/800, Reward: 0.000, Step: 3
2022-11-28 15:29:54 - r - INFO: - Episode: 379/800, Reward: 1.000, Step: 11
2022-11-28 15:29:54 - r - INFO: - Episode: 380/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 380 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 381/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Episode: 382/800, Reward: 0.000, Step: 2
2022-11-28 15:29:54 - r - INFO: - Episode: 383/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 384/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 385/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 385 has the best eval reward: 1.000
2022-11-28 15:29:54 - r - INFO: - Episode: 386/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 387/800, Reward: 1.000, Step: 8
2022-11-28 15:29:54 - r - INFO: - Episode: 388/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Episode: 389/800, Reward: 1.000, Step: 7
2022-11-28 15:29:54 - r - INFO: - Episode: 390/800, Reward: 1.000, Step: 6
2022-11-28 15:29:54 - r - INFO: - Current episode 390 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 391/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 392/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 393/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 394/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 395/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 395 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 396/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 397/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 398/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 399/800, Reward: 1.000, Step: 10
2022-11-28 15:29:55 - r - INFO: - Episode: 400/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Current episode 400 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 401/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 402/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 403/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 404/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 405/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 405 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 406/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 407/800, Reward: 0.000, Step: 4
2022-11-28 15:29:55 - r - INFO: - Episode: 408/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 409/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 410/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 410 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 411/800, Reward: 0.000, Step: 3
2022-11-28 15:29:55 - r - INFO: - Episode: 412/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 413/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 414/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 415/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 415 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 416/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 417/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 418/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 419/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 420/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 420 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 421/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 422/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 423/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 424/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 425/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Current episode 425 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 426/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 427/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 428/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 429/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 430/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 430 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 431/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 432/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 433/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 434/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 435/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 435 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 436/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 437/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 438/800, Reward: 0.000, Step: 3
2022-11-28 15:29:55 - r - INFO: - Episode: 439/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 440/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Current episode 440 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 441/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 442/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 443/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 444/800, Reward: 1.000, Step: 10
2022-11-28 15:29:55 - r - INFO: - Episode: 445/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 445 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 446/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 447/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 448/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 449/800, Reward: 1.000, Step: 10
2022-11-28 15:29:55 - r - INFO: - Episode: 450/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 450 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 451/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 452/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 453/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 454/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 455/800, Reward: 0.000, Step: 5
2022-11-28 15:29:55 - r - INFO: - Current episode 455 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 456/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 457/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 458/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 459/800, Reward: 1.000, Step: 10
2022-11-28 15:29:55 - r - INFO: - Episode: 460/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 460 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 461/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 462/800, Reward: 1.000, Step: 10
2022-11-28 15:29:55 - r - INFO: - Episode: 463/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 464/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 465/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 465 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 466/800, Reward: 1.000, Step: 10
2022-11-28 15:29:55 - r - INFO: - Episode: 467/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 468/800, Reward: 0.000, Step: 4
2022-11-28 15:29:55 - r - INFO: - Episode: 469/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 470/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 470 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 471/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 472/800, Reward: 1.000, Step: 15
2022-11-28 15:29:55 - r - INFO: - Episode: 473/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 474/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 475/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 475 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 476/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 477/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 478/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 479/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 480/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 480 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 481/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 482/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 483/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 484/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 485/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 485 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 486/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 487/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 488/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 489/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 490/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 490 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 491/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 492/800, Reward: 1.000, Step: 10
2022-11-28 15:29:55 - r - INFO: - Episode: 493/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 494/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 495/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 495 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 496/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 497/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 498/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 499/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 500/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 500 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 501/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 502/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 503/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 504/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 505/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 505 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 506/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 507/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 508/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 509/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 510/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 510 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 511/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 512/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 513/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 514/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 515/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 515 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 516/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 517/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 518/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 519/800, Reward: 0.000, Step: 3
2022-11-28 15:29:55 - r - INFO: - Episode: 520/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Current episode 520 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 521/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 522/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 523/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 524/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 525/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 525 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 526/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 527/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 528/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 529/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 530/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 530 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 531/800, Reward: 1.000, Step: 9
2022-11-28 15:29:55 - r - INFO: - Episode: 532/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 533/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 534/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 535/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 535 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 536/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 537/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 538/800, Reward: 1.000, Step: 9
2022-11-28 15:29:55 - r - INFO: - Episode: 539/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 540/800, Reward: 0.000, Step: 4
2022-11-28 15:29:55 - r - INFO: - Current episode 540 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 541/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 542/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 543/800, Reward: 1.000, Step: 11
2022-11-28 15:29:55 - r - INFO: - Episode: 544/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 545/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 545 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 546/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 547/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 548/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 549/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 550/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 550 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 551/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 552/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 553/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 554/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 555/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 555 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 556/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 557/800, Reward: 0.000, Step: 5
2022-11-28 15:29:55 - r - INFO: - Episode: 558/800, Reward: 1.000, Step: 9
2022-11-28 15:29:55 - r - INFO: - Episode: 559/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 560/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 560 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 561/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 562/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 563/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 564/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 565/800, Reward: 0.000, Step: 5
2022-11-28 15:29:55 - r - INFO: - Current episode 565 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 566/800, Reward: 0.000, Step: 3
2022-11-28 15:29:55 - r - INFO: - Episode: 567/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 568/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 569/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 570/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 570 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 571/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 572/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 573/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 574/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 575/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 575 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 576/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 577/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 578/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 579/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 580/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 580 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 581/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 582/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 583/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 584/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 585/800, Reward: 0.000, Step: 4
2022-11-28 15:29:55 - r - INFO: - Current episode 585 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 586/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 587/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 588/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 589/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 590/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 590 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 591/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 592/800, Reward: 0.000, Step: 5
2022-11-28 15:29:55 - r - INFO: - Episode: 593/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 594/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 595/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 595 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 596/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 597/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 598/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 599/800, Reward: 0.000, Step: 3
2022-11-28 15:29:55 - r - INFO: - Episode: 600/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 600 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 601/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 602/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 603/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 604/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 605/800, Reward: 0.000, Step: 4
2022-11-28 15:29:55 - r - INFO: - Current episode 605 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 606/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 607/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 608/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 609/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 610/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 610 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 611/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 612/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 613/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 614/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 615/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 615 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 616/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Episode: 617/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 618/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 619/800, Reward: 0.000, Step: 5
2022-11-28 15:29:55 - r - INFO: - Episode: 620/800, Reward: 0.000, Step: 3
2022-11-28 15:29:55 - r - INFO: - Current episode 620 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 621/800, Reward: 0.000, Step: 3
2022-11-28 15:29:55 - r - INFO: - Episode: 622/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 623/800, Reward: 0.000, Step: 5
2022-11-28 15:29:55 - r - INFO: - Episode: 624/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 625/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 625 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 626/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 627/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 628/800, Reward: 1.000, Step: 7
2022-11-28 15:29:55 - r - INFO: - Episode: 629/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 630/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 630 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 631/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 632/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 633/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 634/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 635/800, Reward: 0.000, Step: 2
2022-11-28 15:29:55 - r - INFO: - Current episode 635 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 636/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 637/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 638/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 639/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 640/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Current episode 640 has the best eval reward: 1.000
2022-11-28 15:29:55 - r - INFO: - Episode: 641/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 642/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 643/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Episode: 644/800, Reward: 1.000, Step: 6
2022-11-28 15:29:55 - r - INFO: - Episode: 645/800, Reward: 1.000, Step: 8
2022-11-28 15:29:55 - r - INFO: - Current episode 645 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 646/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 647/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 648/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 649/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 650/800, Reward: 0.000, Step: 5
2022-11-28 15:29:56 - r - INFO: - Current episode 650 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 651/800, Reward: 0.000, Step: 4
2022-11-28 15:29:56 - r - INFO: - Episode: 652/800, Reward: 0.000, Step: 4
2022-11-28 15:29:56 - r - INFO: - Episode: 653/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 654/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 655/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 655 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 656/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 657/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 658/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 659/800, Reward: 0.000, Step: 4
2022-11-28 15:29:56 - r - INFO: - Episode: 660/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 660 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 661/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 662/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 663/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 664/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 665/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 665 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 666/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 667/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 668/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 669/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 670/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Current episode 670 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 671/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 672/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 673/800, Reward: 1.000, Step: 9
2022-11-28 15:29:56 - r - INFO: - Episode: 674/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 675/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 675 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 676/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 677/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 678/800, Reward: 1.000, Step: 10
2022-11-28 15:29:56 - r - INFO: - Episode: 679/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 680/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 680 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 681/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 682/800, Reward: 1.000, Step: 11
2022-11-28 15:29:56 - r - INFO: - Episode: 683/800, Reward: 1.000, Step: 10
2022-11-28 15:29:56 - r - INFO: - Episode: 684/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 685/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 685 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 686/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 687/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 688/800, Reward: 0.000, Step: 5
2022-11-28 15:29:56 - r - INFO: - Episode: 689/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 690/800, Reward: 0.000, Step: 2
2022-11-28 15:29:56 - r - INFO: - Current episode 690 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 691/800, Reward: 1.000, Step: 9
2022-11-28 15:29:56 - r - INFO: - Episode: 692/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 693/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 694/800, Reward: 1.000, Step: 7
2022-11-28 15:29:56 - r - INFO: - Episode: 695/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 695 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 696/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 697/800, Reward: 1.000, Step: 7
2022-11-28 15:29:56 - r - INFO: - Episode: 698/800, Reward: 0.000, Step: 3
2022-11-28 15:29:56 - r - INFO: - Episode: 699/800, Reward: 1.000, Step: 7
2022-11-28 15:29:56 - r - INFO: - Episode: 700/800, Reward: 0.000, Step: 2
2022-11-28 15:29:56 - r - INFO: - Current episode 700 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 701/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 702/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 703/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 704/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 705/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 705 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 706/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 707/800, Reward: 0.000, Step: 2
2022-11-28 15:29:56 - r - INFO: - Episode: 708/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 709/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 710/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Current episode 710 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 711/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 712/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 713/800, Reward: 1.000, Step: 9
2022-11-28 15:29:56 - r - INFO: - Episode: 714/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 715/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Current episode 715 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 716/800, Reward: 1.000, Step: 11
2022-11-28 15:29:56 - r - INFO: - Episode: 717/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 718/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 719/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 720/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 720 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 721/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 722/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 723/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 724/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 725/800, Reward: 0.000, Step: 5
2022-11-28 15:29:56 - r - INFO: - Current episode 725 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 726/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 727/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 728/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 729/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 730/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 730 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 731/800, Reward: 1.000, Step: 7
2022-11-28 15:29:56 - r - INFO: - Episode: 732/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 733/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 734/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 735/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 735 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 736/800, Reward: 1.000, Step: 10
2022-11-28 15:29:56 - r - INFO: - Episode: 737/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 738/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 739/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 740/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 740 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 741/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 742/800, Reward: 1.000, Step: 7
2022-11-28 15:29:56 - r - INFO: - Episode: 743/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 744/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 745/800, Reward: 1.000, Step: 7
2022-11-28 15:29:56 - r - INFO: - Current episode 745 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 746/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 747/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 748/800, Reward: 1.000, Step: 14
2022-11-28 15:29:56 - r - INFO: - Episode: 749/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 750/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 750 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 751/800, Reward: 1.000, Step: 12
2022-11-28 15:29:56 - r - INFO: - Episode: 752/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 753/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 754/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 755/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 755 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 756/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 757/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 758/800, Reward: 0.000, Step: 3
2022-11-28 15:29:56 - r - INFO: - Episode: 759/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 760/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 760 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 761/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 762/800, Reward: 1.000, Step: 7
2022-11-28 15:29:56 - r - INFO: - Episode: 763/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 764/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 765/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 765 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 766/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 767/800, Reward: 0.000, Step: 2
2022-11-28 15:29:56 - r - INFO: - Episode: 768/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 769/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 770/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 770 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 771/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 772/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 773/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 774/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 775/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 775 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 776/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 777/800, Reward: 0.000, Step: 4
2022-11-28 15:29:56 - r - INFO: - Episode: 778/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 779/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 780/800, Reward: 0.000, Step: 2
2022-11-28 15:29:56 - r - INFO: - Current episode 780 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 781/800, Reward: 1.000, Step: 10
2022-11-28 15:29:56 - r - INFO: - Episode: 782/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 783/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 784/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 785/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 785 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 786/800, Reward: 0.000, Step: 3
2022-11-28 15:29:56 - r - INFO: - Episode: 787/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 788/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 789/800, Reward: 0.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 790/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Current episode 790 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 791/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 792/800, Reward: 1.000, Step: 9
2022-11-28 15:29:56 - r - INFO: - Episode: 793/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 794/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 795/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Current episode 795 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Episode: 796/800, Reward: 1.000, Step: 8
2022-11-28 15:29:56 - r - INFO: - Episode: 797/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 798/800, Reward: 0.000, Step: 5
2022-11-28 15:29:56 - r - INFO: - Episode: 799/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Episode: 800/800, Reward: 1.000, Step: 6
2022-11-28 15:29:56 - r - INFO: - Current episode 800 has the best eval reward: 1.000
2022-11-28 15:29:56 - r - INFO: - Finish training!