Hugging Face's logo

joyrl
/
joyrl-benchmarks

TensorBoard
Model card Files Metrics Community
15
joyrl-benchmarks
File size: 29,474 Bytes 
acaf9b2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
 
2023-05-19 01:08:04 - SimpleLog - INFO: - General Configs:
2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================
2023-05-19 01:08:04 - SimpleLog - INFO: -         Name        	       Value        	        Type        
2023-05-19 01:08:04 - SimpleLog - INFO: -       env_name      	        gym         	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -      algo_name      	       Sarsa        	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -         mode        	       train        	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -        device       	        cpu         	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -         seed        	         1          	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -     max_episode     	        300         	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -       max_step      	        100         	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -     collect_traj    	         0          	   <class 'bool'>   
2023-05-19 01:08:04 - SimpleLog - INFO: -      mp_backend     	       single       	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -      n_workers      	         1          	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -      n_learners     	         1          	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -     share_buffer    	         1          	   <class 'bool'>   
2023-05-19 01:08:04 - SimpleLog - INFO: -     online_eval     	         0          	   <class 'bool'>   
2023-05-19 01:08:04 - SimpleLog - INFO: - online_eval_episode 	         10         	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -    model_save_fre   	        500         	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -   load_checkpoint   	         0          	   <class 'bool'>   
2023-05-19 01:08:04 - SimpleLog - INFO: -      load_path      	Train_single_CliffWalking-v0_QLearning_20230519-005837	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -   load_model_step   	       12000        	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================
2023-05-19 01:08:04 - SimpleLog - INFO: - Algo Configs:
2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================
2023-05-19 01:08:04 - SimpleLog - INFO: -         Name        	       Value        	        Type        
2023-05-19 01:08:04 - SimpleLog - INFO: -    epsilon_start    	        0.95        	  <class 'float'>   
2023-05-19 01:08:04 - SimpleLog - INFO: -     epsilon_end     	        0.01        	  <class 'float'>   
2023-05-19 01:08:04 - SimpleLog - INFO: -    epsilon_decay    	        300         	   <class 'int'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -        gamma        	        0.99        	  <class 'float'>   
2023-05-19 01:08:04 - SimpleLog - INFO: -          lr         	        0.1         	  <class 'float'>   
2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================
2023-05-19 01:08:04 - SimpleLog - INFO: - Env Configs:
2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================
2023-05-19 01:08:04 - SimpleLog - INFO: -         Name        	       Value        	        Type        
2023-05-19 01:08:04 - SimpleLog - INFO: -          id         	  CliffWalking-v0   	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -     render_mode     	        None        	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -       wrapper       	        None        	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: -    ignore_params    	['wrapper', 'ignore_params']	   <class 'str'>    
2023-05-19 01:08:04 - SimpleLog - INFO: - ================================================================================
2023-05-19 01:08:04 - SimpleLog - INFO: - obs_space: Discrete(48), n_actions: Discrete(4)
2023-05-19 01:08:04 - SimpleLog - INFO: - Start training!
2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 0, ep_reward: -496, ep_step: 100
2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 1, ep_reward: -496, ep_step: 100
2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 2, ep_reward: -298, ep_step: 100
2023-05-19 01:08:04 - SimpleLog - INFO: - episode: 3, ep_reward: -298, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 4, ep_reward: -298, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 5, ep_reward: -298, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 6, ep_reward: -199, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 7, ep_reward: -73, ep_step: 73
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 8, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 9, ep_reward: -199, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 10, ep_reward: -199, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 11, ep_reward: -199, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 12, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 13, ep_reward: -71, ep_step: 71
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 14, ep_reward: -89, ep_step: 89
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 15, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 16, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 17, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 18, ep_reward: -81, ep_step: 81
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 19, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 20, ep_reward: -58, ep_step: 58
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 21, ep_reward: -185, ep_step: 86
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 22, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 23, ep_reward: -71, ep_step: 71
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 24, ep_reward: -97, ep_step: 97
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 25, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 26, ep_reward: -55, ep_step: 55
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 27, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 28, ep_reward: -98, ep_step: 98
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 29, ep_reward: -73, ep_step: 73
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 30, ep_reward: -74, ep_step: 74
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 31, ep_reward: -99, ep_step: 99
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 32, ep_reward: -85, ep_step: 85
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 33, ep_reward: -78, ep_step: 78
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 34, ep_reward: -98, ep_step: 98
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 35, ep_reward: -81, ep_step: 81
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 36, ep_reward: -57, ep_step: 57
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 37, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 38, ep_reward: -27, ep_step: 27
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 39, ep_reward: -63, ep_step: 63
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 40, ep_reward: -60, ep_step: 60
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 41, ep_reward: -75, ep_step: 75
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 42, ep_reward: -93, ep_step: 93
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 43, ep_reward: -60, ep_step: 60
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 44, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 45, ep_reward: -83, ep_step: 83
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 46, ep_reward: -70, ep_step: 70
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 47, ep_reward: -74, ep_step: 74
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 48, ep_reward: -86, ep_step: 86
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 49, ep_reward: -67, ep_step: 67
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 50, ep_reward: -93, ep_step: 93
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 51, ep_reward: -45, ep_step: 45
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 52, ep_reward: -100, ep_step: 100
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 53, ep_reward: -75, ep_step: 75
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 54, ep_reward: -51, ep_step: 51
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 55, ep_reward: -55, ep_step: 55
2023-05-19 01:08:05 - SimpleLog - INFO: - episode: 56, ep_reward: -61, ep_step: 61
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 57, ep_reward: -74, ep_step: 74
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 58, ep_reward: -25, ep_step: 25
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 59, ep_reward: -100, ep_step: 100
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 60, ep_reward: -82, ep_step: 82
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 61, ep_reward: -42, ep_step: 42
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 62, ep_reward: -53, ep_step: 53
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 63, ep_reward: -48, ep_step: 48
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 64, ep_reward: -65, ep_step: 65
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 65, ep_reward: -91, ep_step: 91
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 66, ep_reward: -87, ep_step: 87
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 67, ep_reward: -20, ep_step: 20
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 68, ep_reward: -38, ep_step: 38
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 69, ep_reward: -75, ep_step: 75
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 70, ep_reward: -65, ep_step: 65
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 71, ep_reward: -61, ep_step: 61
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 72, ep_reward: -54, ep_step: 54
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 73, ep_reward: -47, ep_step: 47
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 74, ep_reward: -77, ep_step: 77
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 75, ep_reward: -48, ep_step: 48
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 76, ep_reward: -60, ep_step: 60
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 77, ep_reward: -50, ep_step: 50
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 78, ep_reward: -62, ep_step: 62
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 79, ep_reward: -40, ep_step: 40
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 80, ep_reward: -28, ep_step: 28
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 81, ep_reward: -64, ep_step: 64
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 82, ep_reward: -58, ep_step: 58
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 83, ep_reward: -37, ep_step: 37
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 84, ep_reward: -56, ep_step: 56
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 85, ep_reward: -46, ep_step: 46
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 86, ep_reward: -50, ep_step: 50
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 87, ep_reward: -38, ep_step: 38
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 88, ep_reward: -46, ep_step: 46
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 89, ep_reward: -41, ep_step: 41
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 90, ep_reward: -43, ep_step: 43
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 91, ep_reward: -45, ep_step: 45
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 92, ep_reward: -61, ep_step: 61
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 93, ep_reward: -48, ep_step: 48
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 94, ep_reward: -37, ep_step: 37
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 95, ep_reward: -28, ep_step: 28
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 96, ep_reward: -78, ep_step: 78
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 97, ep_reward: -33, ep_step: 33
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 98, ep_reward: -133, ep_step: 34
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 99, ep_reward: -48, ep_step: 48
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 100, ep_reward: -44, ep_step: 44
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 101, ep_reward: -31, ep_step: 31
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 102, ep_reward: -49, ep_step: 49
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 103, ep_reward: -39, ep_step: 39
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 104, ep_reward: -62, ep_step: 62
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 105, ep_reward: -42, ep_step: 42
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 106, ep_reward: -25, ep_step: 25
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 107, ep_reward: -30, ep_step: 30
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 108, ep_reward: -63, ep_step: 63
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 109, ep_reward: -16, ep_step: 16
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 110, ep_reward: -33, ep_step: 33
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 111, ep_reward: -45, ep_step: 45
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 112, ep_reward: -55, ep_step: 55
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 113, ep_reward: -26, ep_step: 26
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 114, ep_reward: -35, ep_step: 35
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 115, ep_reward: -30, ep_step: 30
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 116, ep_reward: -51, ep_step: 51
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 117, ep_reward: -37, ep_step: 37
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 118, ep_reward: -27, ep_step: 27
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 119, ep_reward: -28, ep_step: 28
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 120, ep_reward: -37, ep_step: 37
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 121, ep_reward: -54, ep_step: 54
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 122, ep_reward: -37, ep_step: 37
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 123, ep_reward: -40, ep_step: 40
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 124, ep_reward: -21, ep_step: 21
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 125, ep_reward: -38, ep_step: 38
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 126, ep_reward: -40, ep_step: 40
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 127, ep_reward: -37, ep_step: 37
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 128, ep_reward: -31, ep_step: 31
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 129, ep_reward: -73, ep_step: 73
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 130, ep_reward: -37, ep_step: 37
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 131, ep_reward: -41, ep_step: 41
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 132, ep_reward: -26, ep_step: 26
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 133, ep_reward: -26, ep_step: 26
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 134, ep_reward: -48, ep_step: 48
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 135, ep_reward: -24, ep_step: 24
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 136, ep_reward: -32, ep_step: 32
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 137, ep_reward: -26, ep_step: 26
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 138, ep_reward: -30, ep_step: 30
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 139, ep_reward: -32, ep_step: 32
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 140, ep_reward: -32, ep_step: 32
2023-05-19 01:08:06 - SimpleLog - INFO: - episode: 141, ep_reward: -32, ep_step: 32
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 142, ep_reward: -36, ep_step: 36
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 143, ep_reward: -17, ep_step: 17
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 144, ep_reward: -41, ep_step: 41
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 145, ep_reward: -132, ep_step: 33
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 146, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 147, ep_reward: -34, ep_step: 34
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 148, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 149, ep_reward: -29, ep_step: 29
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 150, ep_reward: -38, ep_step: 38
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 151, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 152, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 153, ep_reward: -37, ep_step: 37
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 154, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 155, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 156, ep_reward: -33, ep_step: 33
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 157, ep_reward: -46, ep_step: 46
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 158, ep_reward: -29, ep_step: 29
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 159, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 160, ep_reward: -32, ep_step: 32
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 161, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 162, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 163, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 164, ep_reward: -25, ep_step: 25
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 165, ep_reward: -39, ep_step: 39
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 166, ep_reward: -27, ep_step: 27
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 167, ep_reward: -24, ep_step: 24
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 168, ep_reward: -14, ep_step: 14
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 169, ep_reward: -37, ep_step: 37
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 170, ep_reward: -33, ep_step: 33
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 171, ep_reward: -34, ep_step: 34
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 172, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 173, ep_reward: -41, ep_step: 41
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 174, ep_reward: -20, ep_step: 20
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 175, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 176, ep_reward: -17, ep_step: 17
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 177, ep_reward: -24, ep_step: 24
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 178, ep_reward: -32, ep_step: 32
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 179, ep_reward: -16, ep_step: 16
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 180, ep_reward: -31, ep_step: 31
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 181, ep_reward: -17, ep_step: 17
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 182, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 183, ep_reward: -31, ep_step: 31
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 184, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 185, ep_reward: -40, ep_step: 40
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 186, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 187, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 188, ep_reward: -29, ep_step: 29
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 189, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 190, ep_reward: -49, ep_step: 49
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 191, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 192, ep_reward: -14, ep_step: 14
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 193, ep_reward: -33, ep_step: 33
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 194, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 195, ep_reward: -20, ep_step: 20
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 196, ep_reward: -27, ep_step: 27
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 197, ep_reward: -28, ep_step: 28
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 198, ep_reward: -26, ep_step: 26
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 199, ep_reward: -37, ep_step: 37
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 200, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 201, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 202, ep_reward: -27, ep_step: 27
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 203, ep_reward: -26, ep_step: 26
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 204, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 205, ep_reward: -24, ep_step: 24
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 206, ep_reward: -28, ep_step: 28
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 207, ep_reward: -18, ep_step: 18
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 208, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 209, ep_reward: -25, ep_step: 25
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 210, ep_reward: -26, ep_step: 26
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 211, ep_reward: -16, ep_step: 16
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 212, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 213, ep_reward: -20, ep_step: 20
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 214, ep_reward: -31, ep_step: 31
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 215, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 216, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 217, ep_reward: -35, ep_step: 35
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 218, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 219, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 220, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 221, ep_reward: -29, ep_step: 29
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 222, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 223, ep_reward: -25, ep_step: 25
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 224, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 225, ep_reward: -26, ep_step: 26
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 226, ep_reward: -27, ep_step: 27
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 227, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 228, ep_reward: -17, ep_step: 17
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 229, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 230, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 231, ep_reward: -20, ep_step: 20
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 232, ep_reward: -28, ep_step: 28
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 233, ep_reward: -18, ep_step: 18
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 234, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 235, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 236, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 237, ep_reward: -30, ep_step: 30
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 238, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 239, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 240, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 241, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 242, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 243, ep_reward: -16, ep_step: 16
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 244, ep_reward: -18, ep_step: 18
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 245, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 246, ep_reward: -35, ep_step: 35
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 247, ep_reward: -18, ep_step: 18
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 248, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 249, ep_reward: -17, ep_step: 17
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 250, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 251, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 252, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 253, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 254, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 255, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 256, ep_reward: -18, ep_step: 18
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 257, ep_reward: -22, ep_step: 22
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 258, ep_reward: -25, ep_step: 25
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 259, ep_reward: -24, ep_step: 24
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 260, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 261, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 262, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 263, ep_reward: -17, ep_step: 17
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 264, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 265, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 266, ep_reward: -24, ep_step: 24
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 267, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 268, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 269, ep_reward: -27, ep_step: 27
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 270, ep_reward: -118, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 271, ep_reward: -20, ep_step: 20
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 272, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 273, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 274, ep_reward: -17, ep_step: 17
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 275, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 276, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 277, ep_reward: -14, ep_step: 14
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 278, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 279, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 280, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 281, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 282, ep_reward: -24, ep_step: 24
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 283, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 284, ep_reward: -25, ep_step: 25
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 285, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 286, ep_reward: -23, ep_step: 23
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 287, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 288, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 289, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 290, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 291, ep_reward: -18, ep_step: 18
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 292, ep_reward: -14, ep_step: 14
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 293, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 294, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 295, ep_reward: -15, ep_step: 15
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 296, ep_reward: -19, ep_step: 19
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 297, ep_reward: -16, ep_step: 16
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 298, ep_reward: -13, ep_step: 13
2023-05-19 01:08:07 - SimpleLog - INFO: - episode: 299, ep_reward: -21, ep_step: 21
2023-05-19 01:08:07 - SimpleLog - INFO: - Finish training! total time consumed: 3.05s