[2022-07-07 03:02:55,113][16446] Weights and Biases integration enabled. Project: sample_factory, user: None, group: None, unique_id: 04_mujoco_all_envs_see_1111_env_mujoco_ant_20220707_030255_113387
[2022-07-07 03:02:55,558][16446] Initializing WandB...
[2022-07-07 03:02:56,868][16446] Environment var CUDA_VISIBLE_DEVICES is 0
[2022-07-07 03:02:59,083][16446] Rollout worker 0 uses device cpu
[2022-07-07 03:02:59,084][16446] Rollout worker 1 uses device cpu
[2022-07-07 03:02:59,085][16446] Rollout worker 2 uses device cpu
[2022-07-07 03:02:59,085][16446] Rollout worker 3 uses device cpu
[2022-07-07 03:02:59,085][16446] Rollout worker 4 uses device cpu
[2022-07-07 03:02:59,086][16446] Rollout worker 5 uses device cpu
[2022-07-07 03:02:59,086][16446] Rollout worker 6 uses device cpu
[2022-07-07 03:02:59,087][16446] Rollout worker 7 uses device cpu
[2022-07-07 03:02:59,087][16446] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1
[2022-07-07 03:02:59,137][16446] Using GPUs [0] for process 0 (actually maps to GPUs [0])
[2022-07-07 03:02:59,137][16446] InferenceWorker_p0-w0: min num requests: 2
[2022-07-07 03:02:59,208][16446] Starting all processes...
[2022-07-07 03:02:59,209][16446] Starting process learner_proc0
[2022-07-07 03:02:59,259][16446] Starting process inference_proc0-0
[2022-07-07 03:02:59,308][16446] Starting process rollout_proc0
[2022-07-07 03:02:59,358][16446] Starting process rollout_proc1
[2022-07-07 03:02:59,408][16446] Starting process rollout_proc2
[2022-07-07 03:02:59,458][16446] Starting process rollout_proc3
[2022-07-07 03:02:59,508][16446] Starting process rollout_proc4
[2022-07-07 03:02:59,558][16446] Starting process rollout_proc5
[2022-07-07 03:02:59,608][16446] Starting process rollout_proc6
[2022-07-07 03:02:59,658][16446] Starting process rollout_proc7
[2022-07-07 03:03:11,108][16446] Inference worker 0-0 is ready!
[2022-07-07 03:03:11,108][16446] All inference workers are ready! Signal rollout workers to start!
[2022-07-07 03:03:36,868][16446] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 8192. Throughput: 0: nan. Samples: 16336. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:03:36,869][16446] Avg episode reward: [(0, '-150.529')]
[2022-07-07 03:03:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 16384. Throughput: 0: 3884.8. Samples: 35760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:03:41,869][16446] Avg episode reward: [(0, '-152.404')]
[2022-07-07 03:03:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 24576. Throughput: 0: 2924.8. Samples: 45584. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:03:46,869][16446] Avg episode reward: [(0, '-140.325')]
[2022-07-07 03:03:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 32768. Throughput: 0: 3218.1. Samples: 64608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:03:51,868][16446] Avg episode reward: [(0, '-122.418')]
[2022-07-07 03:03:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 40960. Throughput: 0: 3279.2. Samples: 81920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:03:56,869][16446] Avg episode reward: [(0, '-201.492')]
[2022-07-07 03:04:01,869][16446] Fps is (10 sec: 1228.7, 60 sec: 1474.5, 300 sec: 1474.5). Total num frames: 45056. Throughput: 0: 2950.9. Samples: 90112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:01,869][16446] Avg episode reward: [(0, '-152.093')]
[2022-07-07 03:04:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1501.9, 300 sec: 1501.9). Total num frames: 53248. Throughput: 0: 3050.9. Samples: 107864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:06,869][16446] Avg episode reward: [(0, '-257.149')]
[2022-07-07 03:04:11,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1521.4, 300 sec: 1521.4). Total num frames: 61440. Throughput: 0: 3187.2. Samples: 127888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:11,869][16446] Avg episode reward: [(0, '-263.855')]
[2022-07-07 03:04:16,871][16446] Fps is (10 sec: 1638.0, 60 sec: 1535.9, 300 sec: 1535.9). Total num frames: 69632. Throughput: 0: 3029.8. Samples: 137536. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:04:16,871][16446] Avg episode reward: [(0, '-186.599')]
[2022-07-07 03:04:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1547.4, 300 sec: 1547.4). Total num frames: 77824. Throughput: 0: 3117.3. Samples: 156616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:04:21,868][16446] Avg episode reward: [(0, '-171.220')]
[2022-07-07 03:04:26,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1556.5, 300 sec: 1556.5). Total num frames: 86016. Throughput: 0: 3113.6. Samples: 175872. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:04:26,869][16446] Avg episode reward: [(0, '-161.085')]
[2022-07-07 03:04:31,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1563.9, 300 sec: 1563.9). Total num frames: 94208. Throughput: 0: 3160.4. Samples: 187808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:31,870][16446] Avg episode reward: [(0, '-104.828')]
[2022-07-07 03:04:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1570.1). Total num frames: 102400. Throughput: 0: 3105.6. Samples: 204360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:36,869][16446] Avg episode reward: [(0, '-155.567')]
[2022-07-07 03:04:41,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1570.1, 300 sec: 1575.4). Total num frames: 110592. Throughput: 0: 3117.3. Samples: 222200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:41,869][16446] Avg episode reward: [(0, '-186.727')]
[2022-07-07 03:04:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1579.9). Total num frames: 118784. Throughput: 0: 3137.8. Samples: 231312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:04:46,869][16446] Avg episode reward: [(0, '-193.278')]
[2022-07-07 03:04:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1583.8). Total num frames: 126976. Throughput: 0: 3202.7. Samples: 251984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:51,869][16446] Avg episode reward: [(0, '-123.954')]
[2022-07-07 03:04:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1587.2). Total num frames: 135168. Throughput: 0: 3161.2. Samples: 270144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:04:56,870][16446] Avg episode reward: [(0, '-200.352')]
[2022-07-07 03:05:01,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.2, 300 sec: 1542.0). Total num frames: 139264. Throughput: 0: 3133.2. Samples: 278520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:05:01,869][16446] Avg episode reward: [(0, '-130.658')]
[2022-07-07 03:05:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1547.4). Total num frames: 147456. Throughput: 0: 3076.4. Samples: 295056. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:05:06,870][16446] Avg episode reward: [(0, '-104.360')]
[2022-07-07 03:05:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1552.2). Total num frames: 155648. Throughput: 0: 3139.5. Samples: 317152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:05:11,869][16446] Avg episode reward: [(0, '-160.113')]
[2022-07-07 03:05:16,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1570.2, 300 sec: 1556.5). Total num frames: 163840. Throughput: 0: 3096.7. Samples: 327160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:05:16,870][16446] Avg episode reward: [(0, '-173.046')]
[2022-07-07 03:05:21,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1570.1, 300 sec: 1560.4). Total num frames: 172032. Throughput: 0: 3103.9. Samples: 344040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:05:21,870][16446] Avg episode reward: [(0, '-88.218')]
[2022-07-07 03:05:26,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1570.1, 300 sec: 1563.9). Total num frames: 180224. Throughput: 0: 3152.5. Samples: 364064. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:05:26,869][16446] Avg episode reward: [(0, '-67.798')]
[2022-07-07 03:05:31,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1570.2, 300 sec: 1567.2). Total num frames: 188416. Throughput: 0: 3139.2. Samples: 372576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:05:31,869][16446] Avg episode reward: [(0, '-73.936')]
[2022-07-07 03:05:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1570.1). Total num frames: 196608. Throughput: 0: 3119.8. Samples: 392376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:05:36,868][16446] Avg episode reward: [(0, '-90.229')]
[2022-07-07 03:05:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1572.9). Total num frames: 204800. Throughput: 0: 3135.3. Samples: 411232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:05:41,869][16446] Avg episode reward: [(0, '-103.699')]
[2022-07-07 03:05:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1575.4). Total num frames: 212992. Throughput: 0: 3117.9. Samples: 418824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:05:46,869][16446] Avg episode reward: [(0, '-104.479')]
[2022-07-07 03:05:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1577.7). Total num frames: 221184. Throughput: 0: 3171.6. Samples: 437776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:05:51,869][16446] Avg episode reward: [(0, '-75.795')]
[2022-07-07 03:05:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1579.9). Total num frames: 229376. Throughput: 0: 3140.5. Samples: 458472. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:05:56,869][16446] Avg episode reward: [(0, '-85.001')]
[2022-07-07 03:06:01,870][16446] Fps is (10 sec: 1228.6, 60 sec: 1570.1, 300 sec: 1553.6). Total num frames: 233472. Throughput: 0: 3106.3. Samples: 466944. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:06:01,870][16446] Avg episode reward: [(0, '-92.320')]
[2022-07-07 03:06:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1556.5). Total num frames: 241664. Throughput: 0: 3126.5. Samples: 484728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:06:06,869][16446] Avg episode reward: [(0, '-54.961')]
[2022-07-07 03:06:11,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1570.1, 300 sec: 1559.1). Total num frames: 249856. Throughput: 0: 3118.9. Samples: 504416. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:06:11,869][16446] Avg episode reward: [(0, '-74.845')]
[2022-07-07 03:06:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1561.6). Total num frames: 258048. Throughput: 0: 3148.1. Samples: 514240. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:06:16,869][16446] Avg episode reward: [(0, '-65.262')]
[2022-07-07 03:06:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1563.9). Total num frames: 266240. Throughput: 0: 3101.5. Samples: 531944. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:06:21,869][16446] Avg episode reward: [(0, '-71.773')]
[2022-07-07 03:06:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1566.1). Total num frames: 274432. Throughput: 0: 3082.0. Samples: 549920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:06:26,869][16446] Avg episode reward: [(0, '-71.885')]
[2022-07-07 03:06:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1568.2). Total num frames: 282624. Throughput: 0: 3138.8. Samples: 560072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:06:31,868][16446] Avg episode reward: [(0, '-50.731')]
[2022-07-07 03:06:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1570.1). Total num frames: 290816. Throughput: 0: 3178.8. Samples: 580824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:06:36,868][16446] Avg episode reward: [(0, '-23.081')]
[2022-07-07 03:06:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1572.0). Total num frames: 299008. Throughput: 0: 3101.0. Samples: 598016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:06:41,869][16446] Avg episode reward: [(0, '-19.384')]
[2022-07-07 03:06:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1573.7). Total num frames: 307200. Throughput: 0: 3122.4. Samples: 607448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:06:46,869][16446] Avg episode reward: [(0, '-23.207')]
[2022-07-07 03:06:51,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1501.9, 300 sec: 1554.4). Total num frames: 311296. Throughput: 0: 3172.6. Samples: 627496. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:06:51,869][16446] Avg episode reward: [(0, '-12.328')]
[2022-07-07 03:06:56,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1501.9, 300 sec: 1556.5). Total num frames: 319488. Throughput: 0: 3122.3. Samples: 644920. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:06:56,869][16446] Avg episode reward: [(0, '-7.643')]
[2022-07-07 03:07:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1558.5). Total num frames: 327680. Throughput: 0: 3124.3. Samples: 654832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:07:01,869][16446] Avg episode reward: [(0, '-1.547')]
[2022-07-07 03:07:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1560.4). Total num frames: 335872. Throughput: 0: 3103.1. Samples: 671584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:07:06,869][16446] Avg episode reward: [(0, '2.471')]
[2022-07-07 03:07:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1562.2). Total num frames: 344064. Throughput: 0: 3079.5. Samples: 688496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:07:11,869][16446] Avg episode reward: [(0, '5.557')]
[2022-07-07 03:07:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1563.9). Total num frames: 352256. Throughput: 0: 3037.0. Samples: 696736. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:07:16,869][16446] Avg episode reward: [(0, '9.697')]
[2022-07-07 03:07:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1565.6). Total num frames: 360448. Throughput: 0: 3025.6. Samples: 716976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:07:21,869][16446] Avg episode reward: [(0, '18.199')]
[2022-07-07 03:07:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1567.2). Total num frames: 368640. Throughput: 0: 3091.6. Samples: 737136. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:07:26,869][16446] Avg episode reward: [(0, '29.238')]
[2022-07-07 03:07:31,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1501.9, 300 sec: 1551.3). Total num frames: 372736. Throughput: 0: 3074.8. Samples: 745816. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:07:31,869][16446] Avg episode reward: [(0, '46.923')]
[2022-07-07 03:07:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1570.1). Total num frames: 385024. Throughput: 0: 3057.1. Samples: 765064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:07:36,869][16446] Avg episode reward: [(0, '62.887')]
[2022-07-07 03:07:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1570.1, 300 sec: 1571.5). Total num frames: 393216. Throughput: 0: 3142.4. Samples: 786328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:07:41,869][16446] Avg episode reward: [(0, '77.303')]
[2022-07-07 03:07:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1572.9). Total num frames: 401408. Throughput: 0: 3117.2. Samples: 795104. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:07:46,869][16446] Avg episode reward: [(0, '89.807')]
[2022-07-07 03:07:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1574.1). Total num frames: 409600. Throughput: 0: 3165.5. Samples: 814032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:07:51,868][16446] Avg episode reward: [(0, '112.024')]
[2022-07-07 03:07:56,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1559.6). Total num frames: 413696. Throughput: 0: 3232.4. Samples: 833952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:07:56,869][16446] Avg episode reward: [(0, '131.105')]
[2022-07-07 03:08:01,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1561.1). Total num frames: 421888. Throughput: 0: 3256.4. Samples: 843272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:01,869][16446] Avg episode reward: [(0, '145.201')]
[2022-07-07 03:08:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1562.5). Total num frames: 430080. Throughput: 0: 3181.9. Samples: 860160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:06,875][16446] Avg episode reward: [(0, '153.626')]
[2022-07-07 03:08:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1563.9). Total num frames: 438272. Throughput: 0: 3164.3. Samples: 879528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:11,869][16446] Avg episode reward: [(0, '170.762')]
[2022-07-07 03:08:16,873][16446] Fps is (10 sec: 1637.6, 60 sec: 1570.0, 300 sec: 1565.2). Total num frames: 446464. Throughput: 0: 3182.9. Samples: 889064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:16,874][16446] Avg episode reward: [(0, '193.577')]
[2022-07-07 03:08:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1566.5). Total num frames: 454656. Throughput: 0: 3203.9. Samples: 909240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:21,869][16446] Avg episode reward: [(0, '210.533')]
[2022-07-07 03:08:26,868][16446] Fps is (10 sec: 1639.3, 60 sec: 1570.1, 300 sec: 1567.8). Total num frames: 462848. Throughput: 0: 3146.0. Samples: 927896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:26,868][16446] Avg episode reward: [(0, '229.530')]
[2022-07-07 03:08:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1569.0). Total num frames: 471040. Throughput: 0: 3208.5. Samples: 939488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:08:31,869][16446] Avg episode reward: [(0, '256.539')]
[2022-07-07 03:08:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1569.0). Total num frames: 479232. Throughput: 0: 3224.0. Samples: 959112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:36,869][16446] Avg episode reward: [(0, '271.290')]
[2022-07-07 03:08:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1569.0). Total num frames: 487424. Throughput: 0: 3222.0. Samples: 978944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:41,869][16446] Avg episode reward: [(0, '282.680')]
[2022-07-07 03:08:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1569.0). Total num frames: 495616. Throughput: 0: 3269.5. Samples: 990400. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:08:46,869][16446] Avg episode reward: [(0, '308.474')]
[2022-07-07 03:08:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1569.0). Total num frames: 503808. Throughput: 0: 3302.2. Samples: 1008760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:51,869][16446] Avg episode reward: [(0, '337.671')]
[2022-07-07 03:08:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 512000. Throughput: 0: 3362.8. Samples: 1030856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:08:56,869][16446] Avg episode reward: [(0, '377.466')]
[2022-07-07 03:09:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 520192. Throughput: 0: 3359.5. Samples: 1040224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:01,869][16446] Avg episode reward: [(0, '406.054')]
[2022-07-07 03:09:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 528384. Throughput: 0: 3275.2. Samples: 1056624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:06,869][16446] Avg episode reward: [(0, '426.253')]
[2022-07-07 03:09:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 536576. Throughput: 0: 3283.0. Samples: 1075632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:11,869][16446] Avg episode reward: [(0, '453.165')]
[2022-07-07 03:09:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1582.9). Total num frames: 544768. Throughput: 0: 3256.2. Samples: 1086016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:09:16,869][16446] Avg episode reward: [(0, '473.701')]
[2022-07-07 03:09:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 552960. Throughput: 0: 3258.3. Samples: 1105736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:21,869][16446] Avg episode reward: [(0, '479.860')]
[2022-07-07 03:09:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 561152. Throughput: 0: 3225.2. Samples: 1124080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:26,869][16446] Avg episode reward: [(0, '488.657')]
[2022-07-07 03:09:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 569344. Throughput: 0: 3216.4. Samples: 1135136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:09:31,869][16446] Avg episode reward: [(0, '516.088')]
[2022-07-07 03:09:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 577536. Throughput: 0: 3251.4. Samples: 1155072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:36,868][16446] Avg episode reward: [(0, '557.158')]
[2022-07-07 03:09:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 585728. Throughput: 0: 3235.4. Samples: 1176448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:41,869][16446] Avg episode reward: [(0, '589.425')]
[2022-07-07 03:09:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 593920. Throughput: 0: 3258.7. Samples: 1186864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:09:46,869][16446] Avg episode reward: [(0, '612.247')]
[2022-07-07 03:09:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 602112. Throughput: 0: 3307.0. Samples: 1205440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:51,869][16446] Avg episode reward: [(0, '636.308')]
[2022-07-07 03:09:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 610304. Throughput: 0: 3337.8. Samples: 1225832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:09:56,869][16446] Avg episode reward: [(0, '652.635')]
[2022-07-07 03:10:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 618496. Throughput: 0: 3333.0. Samples: 1236000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:10:01,869][16446] Avg episode reward: [(0, '660.689')]
[2022-07-07 03:10:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 626688. Throughput: 0: 3277.9. Samples: 1253240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:10:06,868][16446] Avg episode reward: [(0, '668.932')]
[2022-07-07 03:10:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.8). Total num frames: 634880. Throughput: 0: 3279.8. Samples: 1271672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:10:11,874][16446] Avg episode reward: [(0, '666.963')]
[2022-07-07 03:10:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.8). Total num frames: 643072. Throughput: 0: 3248.5. Samples: 1281320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:10:16,869][16446] Avg episode reward: [(0, '701.450')]
[2022-07-07 03:10:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 651264. Throughput: 0: 3237.9. Samples: 1300776. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:10:21,869][16446] Avg episode reward: [(0, '717.780')]
[2022-07-07 03:10:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 659456. Throughput: 0: 3165.9. Samples: 1318912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:10:26,869][16446] Avg episode reward: [(0, '736.716')]
[2022-07-07 03:10:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 667648. Throughput: 0: 3155.2. Samples: 1328848. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:10:31,869][16446] Avg episode reward: [(0, '711.906')]
[2022-07-07 03:10:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 675840. Throughput: 0: 3204.8. Samples: 1349656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:10:36,869][16446] Avg episode reward: [(0, '700.912')]
[2022-07-07 03:10:41,871][16446] Fps is (10 sec: 1638.0, 60 sec: 1638.3, 300 sec: 1596.7). Total num frames: 684032. Throughput: 0: 3175.5. Samples: 1368736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:10:41,871][16446] Avg episode reward: [(0, '709.532')]
[2022-07-07 03:10:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 692224. Throughput: 0: 3149.5. Samples: 1377728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:10:46,869][16446] Avg episode reward: [(0, '680.643')]
[2022-07-07 03:10:51,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 700416. Throughput: 0: 3200.5. Samples: 1397264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:10:51,869][16446] Avg episode reward: [(0, '707.385')]
[2022-07-07 03:10:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 708608. Throughput: 0: 3229.5. Samples: 1417000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:10:56,869][16446] Avg episode reward: [(0, '726.561')]
[2022-07-07 03:11:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.3, 300 sec: 1610.6). Total num frames: 716800. Throughput: 0: 3214.5. Samples: 1425984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:11:01,871][16446] Avg episode reward: [(0, '726.554')]
[2022-07-07 03:11:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 724992. Throughput: 0: 3221.3. Samples: 1445736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:11:06,869][16446] Avg episode reward: [(0, '701.399')]
[2022-07-07 03:11:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 733184. Throughput: 0: 3274.1. Samples: 1466248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:11:11,869][16446] Avg episode reward: [(0, '707.753')]
[2022-07-07 03:11:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 741376. Throughput: 0: 3263.1. Samples: 1475688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:11:16,869][16446] Avg episode reward: [(0, '744.481')]
[2022-07-07 03:11:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 749568. Throughput: 0: 3279.1. Samples: 1497216. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:11:21,869][16446] Avg episode reward: [(0, '788.115')]
[2022-07-07 03:11:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 757760. Throughput: 0: 3268.4. Samples: 1515808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:11:26,869][16446] Avg episode reward: [(0, '781.666')]
[2022-07-07 03:11:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 765952. Throughput: 0: 3293.9. Samples: 1525952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:11:31,869][16446] Avg episode reward: [(0, '817.412')]
[2022-07-07 03:11:36,872][16446] Fps is (10 sec: 1637.8, 60 sec: 1638.3, 300 sec: 1610.6). Total num frames: 774144. Throughput: 0: 3315.1. Samples: 1546456. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:11:36,872][16446] Avg episode reward: [(0, '824.547')]
[2022-07-07 03:11:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1610.6). Total num frames: 782336. Throughput: 0: 3279.6. Samples: 1564584. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:11:41,869][16446] Avg episode reward: [(0, '849.469')]
[2022-07-07 03:11:46,868][16446] Fps is (10 sec: 1639.0, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 790528. Throughput: 0: 3277.0. Samples: 1573440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:11:46,869][16446] Avg episode reward: [(0, '880.543')]
[2022-07-07 03:11:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 798720. Throughput: 0: 3344.7. Samples: 1596248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:11:51,868][16446] Avg episode reward: [(0, '893.271')]
[2022-07-07 03:11:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 806912. Throughput: 0: 3282.3. Samples: 1613952. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:11:56,869][16446] Avg episode reward: [(0, '936.106')]
[2022-07-07 03:12:01,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1638.3, 300 sec: 1624.5). Total num frames: 815104. Throughput: 0: 3280.8. Samples: 1623344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:12:01,875][16446] Avg episode reward: [(0, '928.528')]
[2022-07-07 03:12:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 823296. Throughput: 0: 3259.0. Samples: 1643872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:12:06,868][16446] Avg episode reward: [(0, '931.939')]
[2022-07-07 03:12:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 831488. Throughput: 0: 3270.4. Samples: 1662976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:12:11,869][16446] Avg episode reward: [(0, '940.523')]
[2022-07-07 03:12:16,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 835584. Throughput: 0: 3235.0. Samples: 1671528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:12:16,868][16446] Avg episode reward: [(0, '962.849')]
[2022-07-07 03:12:21,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 843776. Throughput: 0: 3199.7. Samples: 1690432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:12:21,874][16446] Avg episode reward: [(0, '1007.528')]
[2022-07-07 03:12:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 851968. Throughput: 0: 3203.2. Samples: 1708728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:12:26,869][16446] Avg episode reward: [(0, '1041.296')]
[2022-07-07 03:12:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 860160. Throughput: 0: 3241.2. Samples: 1719296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:12:31,869][16446] Avg episode reward: [(0, '1051.722')]
[2022-07-07 03:12:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1610.6). Total num frames: 868352. Throughput: 0: 3124.1. Samples: 1736832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:12:36,869][16446] Avg episode reward: [(0, '1077.231')]
[2022-07-07 03:12:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 876544. Throughput: 0: 3177.1. Samples: 1756920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:12:41,873][16446] Avg episode reward: [(0, '1112.690')]
[2022-07-07 03:12:46,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 884736. Throughput: 0: 3200.1. Samples: 1767328. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:12:46,869][16446] Avg episode reward: [(0, '1123.602')]
[2022-07-07 03:12:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 892928. Throughput: 0: 3179.0. Samples: 1786928. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:12:51,869][16446] Avg episode reward: [(0, '1133.858')]
[2022-07-07 03:12:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 901120. Throughput: 0: 3210.7. Samples: 1807456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:12:56,869][16446] Avg episode reward: [(0, '1133.612')]
[2022-07-07 03:13:01,879][16446] Fps is (10 sec: 1636.6, 60 sec: 1570.0, 300 sec: 1624.5). Total num frames: 909312. Throughput: 0: 3263.2. Samples: 1818408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:13:01,880][16446] Avg episode reward: [(0, '1170.693')]
[2022-07-07 03:13:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 917504. Throughput: 0: 3210.8. Samples: 1834920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:13:06,869][16446] Avg episode reward: [(0, '1200.943')]
[2022-07-07 03:13:11,868][16446] Fps is (10 sec: 1640.2, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 925696. Throughput: 0: 3181.3. Samples: 1851888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:13:11,869][16446] Avg episode reward: [(0, '1168.555')]
[2022-07-07 03:13:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 933888. Throughput: 0: 3161.1. Samples: 1861544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:13:16,869][16446] Avg episode reward: [(0, '1148.945')]
[2022-07-07 03:13:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 942080. Throughput: 0: 3178.1. Samples: 1879848. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:13:21,869][16446] Avg episode reward: [(0, '1136.942')]
[2022-07-07 03:13:26,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 946176. Throughput: 0: 3168.7. Samples: 1899512. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:13:26,869][16446] Avg episode reward: [(0, '1173.976')]
[2022-07-07 03:13:31,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 954368. Throughput: 0: 3133.5. Samples: 1908336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:13:31,869][16446] Avg episode reward: [(0, '1179.362')]
[2022-07-07 03:13:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 962560. Throughput: 0: 3098.3. Samples: 1926352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:13:36,869][16446] Avg episode reward: [(0, '1185.979')]
[2022-07-07 03:13:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 970752. Throughput: 0: 3067.6. Samples: 1945496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:13:41,869][16446] Avg episode reward: [(0, '1224.915')]
[2022-07-07 03:13:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 978944. Throughput: 0: 3023.5. Samples: 1954432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:13:46,869][16446] Avg episode reward: [(0, '1192.619')]
[2022-07-07 03:13:51,874][16446] Fps is (10 sec: 1637.4, 60 sec: 1570.0, 300 sec: 1610.6). Total num frames: 987136. Throughput: 0: 3096.3. Samples: 1974272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:13:51,875][16446] Avg episode reward: [(0, '1178.788')]
[2022-07-07 03:13:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 995328. Throughput: 0: 3128.7. Samples: 1992680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:13:56,869][16446] Avg episode reward: [(0, '1186.132')]
[2022-07-07 03:14:01,872][16446] Fps is (10 sec: 1638.8, 60 sec: 1570.3, 300 sec: 1610.6). Total num frames: 1003520. Throughput: 0: 3107.8. Samples: 2001408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:14:01,873][16446] Avg episode reward: [(0, '1189.343')]
[2022-07-07 03:14:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 1011712. Throughput: 0: 3117.7. Samples: 2020144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:06,869][16446] Avg episode reward: [(0, '1192.974')]
[2022-07-07 03:14:11,868][16446] Fps is (10 sec: 1639.0, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 1019904. Throughput: 0: 3116.4. Samples: 2039752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:11,869][16446] Avg episode reward: [(0, '1224.740')]
[2022-07-07 03:14:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 1028096. Throughput: 0: 3131.9. Samples: 2049272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:16,869][16446] Avg episode reward: [(0, '1227.694')]
[2022-07-07 03:14:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 1036288. Throughput: 0: 3184.5. Samples: 2069656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:14:21,869][16446] Avg episode reward: [(0, '1245.973')]
[2022-07-07 03:14:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 1044480. Throughput: 0: 3178.8. Samples: 2088544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:14:26,869][16446] Avg episode reward: [(0, '1237.409')]
[2022-07-07 03:14:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 1052672. Throughput: 0: 3171.6. Samples: 2097152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:31,869][16446] Avg episode reward: [(0, '1293.763')]
[2022-07-07 03:14:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 1060864. Throughput: 0: 3197.8. Samples: 2118152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:36,868][16446] Avg episode reward: [(0, '1354.656')]
[2022-07-07 03:14:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 1069056. Throughput: 0: 3227.6. Samples: 2137920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:41,869][16446] Avg episode reward: [(0, '1387.153')]
[2022-07-07 03:14:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 1077248. Throughput: 0: 3255.8. Samples: 2147904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:46,869][16446] Avg episode reward: [(0, '1446.845')]
[2022-07-07 03:14:51,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.5, 300 sec: 1610.6). Total num frames: 1085440. Throughput: 0: 3341.6. Samples: 2170520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:51,870][16446] Avg episode reward: [(0, '1495.438')]
[2022-07-07 03:14:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 1093632. Throughput: 0: 3287.3. Samples: 2187680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:14:56,869][16446] Avg episode reward: [(0, '1511.859')]
[2022-07-07 03:15:01,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.5, 300 sec: 1610.6). Total num frames: 1101824. Throughput: 0: 3281.4. Samples: 2196936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:15:01,869][16446] Avg episode reward: [(0, '1584.233')]
[2022-07-07 03:15:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1105920. Throughput: 0: 3251.9. Samples: 2215992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:15:06,869][16446] Avg episode reward: [(0, '1605.429')]
[2022-07-07 03:15:11,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1114112. Throughput: 0: 3275.9. Samples: 2235960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:15:11,869][16446] Avg episode reward: [(0, '1635.524')]
[2022-07-07 03:15:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1122304. Throughput: 0: 3273.6. Samples: 2244464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:15:16,868][16446] Avg episode reward: [(0, '1636.059')]
[2022-07-07 03:15:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1130496. Throughput: 0: 3252.1. Samples: 2264496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:15:21,869][16446] Avg episode reward: [(0, '1675.232')]
[2022-07-07 03:15:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1138688. Throughput: 0: 3232.0. Samples: 2283360. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:15:26,870][16446] Avg episode reward: [(0, '1668.052')]
[2022-07-07 03:15:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1146880. Throughput: 0: 3212.4. Samples: 2292464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:15:31,869][16446] Avg episode reward: [(0, '1715.859')]
[2022-07-07 03:15:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.8). Total num frames: 1155072. Throughput: 0: 3143.7. Samples: 2311984. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:15:36,870][16446] Avg episode reward: [(0, '1719.406')]
[2022-07-07 03:15:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1163264. Throughput: 0: 3219.6. Samples: 2332560. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:15:41,868][16446] Avg episode reward: [(0, '1728.583')]
[2022-07-07 03:15:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1171456. Throughput: 0: 3221.0. Samples: 2341880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:15:46,869][16446] Avg episode reward: [(0, '1741.212')]
[2022-07-07 03:15:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1596.7). Total num frames: 1179648. Throughput: 0: 3216.4. Samples: 2360728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:15:51,869][16446] Avg episode reward: [(0, '1767.683')]
[2022-07-07 03:15:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.8). Total num frames: 1187840. Throughput: 0: 3208.5. Samples: 2380344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:15:56,869][16446] Avg episode reward: [(0, '1765.665')]
[2022-07-07 03:16:01,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1570.0, 300 sec: 1596.7). Total num frames: 1196032. Throughput: 0: 3207.3. Samples: 2388816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:16:01,875][16446] Avg episode reward: [(0, '1805.987')]
[2022-07-07 03:16:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1204224. Throughput: 0: 3146.5. Samples: 2406088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:16:06,868][16446] Avg episode reward: [(0, '1879.573')]
[2022-07-07 03:16:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1212416. Throughput: 0: 3142.4. Samples: 2424768. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:16:11,869][16446] Avg episode reward: [(0, '1923.135')]
[2022-07-07 03:16:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1220608. Throughput: 0: 3149.7. Samples: 2434200. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:16:16,869][16446] Avg episode reward: [(0, '1907.916')]
[2022-07-07 03:16:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1228800. Throughput: 0: 3146.8. Samples: 2453592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:16:21,869][16446] Avg episode reward: [(0, '1966.487')]
[2022-07-07 03:16:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1236992. Throughput: 0: 3139.5. Samples: 2473840. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:16:26,869][16446] Avg episode reward: [(0, '1914.862')]
[2022-07-07 03:16:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.8). Total num frames: 1245184. Throughput: 0: 3117.5. Samples: 2482168. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:16:31,868][16446] Avg episode reward: [(0, '1957.642')]
[2022-07-07 03:16:36,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1249280. Throughput: 0: 3116.8. Samples: 2500984. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:16:36,869][16446] Avg episode reward: [(0, '1975.975')]
[2022-07-07 03:16:41,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1257472. Throughput: 0: 3087.3. Samples: 2519272. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:16:41,869][16446] Avg episode reward: [(0, '1972.671')]
[2022-07-07 03:16:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1265664. Throughput: 0: 3096.5. Samples: 2528136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:16:46,869][16446] Avg episode reward: [(0, '2000.860')]
[2022-07-07 03:16:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1273856. Throughput: 0: 3130.0. Samples: 2546936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:16:51,869][16446] Avg episode reward: [(0, '2016.336')]
[2022-07-07 03:16:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1282048. Throughput: 0: 3100.1. Samples: 2564272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:16:56,870][16446] Avg episode reward: [(0, '2060.069')]
[2022-07-07 03:17:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.3, 300 sec: 1582.9). Total num frames: 1290240. Throughput: 0: 3069.9. Samples: 2572344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:01,875][16446] Avg episode reward: [(0, '2067.656')]
[2022-07-07 03:17:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1501.9, 300 sec: 1569.0). Total num frames: 1294336. Throughput: 0: 3061.3. Samples: 2591352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:06,869][16446] Avg episode reward: [(0, '2122.388')]
[2022-07-07 03:17:11,870][16446] Fps is (10 sec: 1228.6, 60 sec: 1501.8, 300 sec: 1582.9). Total num frames: 1302528. Throughput: 0: 3058.7. Samples: 2611488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:11,870][16446] Avg episode reward: [(0, '2202.856')]
[2022-07-07 03:17:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1501.9, 300 sec: 1582.9). Total num frames: 1310720. Throughput: 0: 3091.6. Samples: 2621288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:16,869][16446] Avg episode reward: [(0, '2225.947')]
[2022-07-07 03:17:21,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1501.9, 300 sec: 1582.9). Total num frames: 1318912. Throughput: 0: 3041.4. Samples: 2637848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:21,868][16446] Avg episode reward: [(0, '2265.337')]
[2022-07-07 03:17:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1501.9, 300 sec: 1582.9). Total num frames: 1327104. Throughput: 0: 3117.3. Samples: 2659552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:26,869][16446] Avg episode reward: [(0, '2263.284')]
[2022-07-07 03:17:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1501.9, 300 sec: 1582.9). Total num frames: 1335296. Throughput: 0: 3153.2. Samples: 2670032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:17:31,869][16446] Avg episode reward: [(0, '2297.115')]
[2022-07-07 03:17:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1343488. Throughput: 0: 3117.3. Samples: 2687216. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:17:36,869][16446] Avg episode reward: [(0, '2270.154')]
[2022-07-07 03:17:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1351680. Throughput: 0: 3176.7. Samples: 2707224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:41,869][16446] Avg episode reward: [(0, '2252.929')]
[2022-07-07 03:17:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1359872. Throughput: 0: 3210.8. Samples: 2716832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:46,869][16446] Avg episode reward: [(0, '2267.463')]
[2022-07-07 03:17:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1368064. Throughput: 0: 3208.9. Samples: 2735752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:51,869][16446] Avg episode reward: [(0, '2324.004')]
[2022-07-07 03:17:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1376256. Throughput: 0: 3151.6. Samples: 2753304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:17:56,869][16446] Avg episode reward: [(0, '2302.643')]
[2022-07-07 03:18:01,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1570.0, 300 sec: 1582.8). Total num frames: 1384448. Throughput: 0: 3154.9. Samples: 2763280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:18:01,875][16446] Avg episode reward: [(0, '2368.616')]
[2022-07-07 03:18:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 1392640. Throughput: 0: 3199.5. Samples: 2781824. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:18:06,869][16446] Avg episode reward: [(0, '2393.783')]
[2022-07-07 03:18:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 1400832. Throughput: 0: 3130.3. Samples: 2800416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:18:11,869][16446] Avg episode reward: [(0, '2397.622')]
[2022-07-07 03:18:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 1409024. Throughput: 0: 3109.7. Samples: 2809968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:18:16,869][16446] Avg episode reward: [(0, '2467.040')]
[2022-07-07 03:18:21,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1413120. Throughput: 0: 3152.4. Samples: 2829072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:18:21,869][16446] Avg episode reward: [(0, '2547.089')]
[2022-07-07 03:18:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1425408. Throughput: 0: 3173.5. Samples: 2850032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:18:26,869][16446] Avg episode reward: [(0, '2621.691')]
[2022-07-07 03:18:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1433600. Throughput: 0: 3158.0. Samples: 2858944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:18:31,869][16446] Avg episode reward: [(0, '2650.453')]
[2022-07-07 03:18:36,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1437696. Throughput: 0: 3174.9. Samples: 2878624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:18:36,869][16446] Avg episode reward: [(0, '2694.085')]
[2022-07-07 03:18:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1449984. Throughput: 0: 3242.8. Samples: 2899232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:18:41,869][16446] Avg episode reward: [(0, '2744.351')]
[2022-07-07 03:18:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1596.8). Total num frames: 1458176. Throughput: 0: 3219.5. Samples: 2908136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:18:46,869][16446] Avg episode reward: [(0, '2779.139')]
[2022-07-07 03:18:51,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1462272. Throughput: 0: 3253.0. Samples: 2928208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:18:51,868][16446] Avg episode reward: [(0, '2819.485')]
[2022-07-07 03:18:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.8). Total num frames: 1474560. Throughput: 0: 3302.9. Samples: 2949048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:18:56,869][16446] Avg episode reward: [(0, '2874.248')]
[2022-07-07 03:19:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.6, 300 sec: 1596.7). Total num frames: 1482752. Throughput: 0: 3290.7. Samples: 2958048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:19:01,869][16446] Avg episode reward: [(0, '2918.335')]
[2022-07-07 03:19:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1490944. Throughput: 0: 3326.0. Samples: 2978744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:19:06,869][16446] Avg episode reward: [(0, '2964.029')]
[2022-07-07 03:19:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1499136. Throughput: 0: 3281.8. Samples: 2997712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:19:11,869][16446] Avg episode reward: [(0, '2936.860')]
[2022-07-07 03:19:16,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1503232. Throughput: 0: 3281.1. Samples: 3006592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:19:16,869][16446] Avg episode reward: [(0, '3043.482')]
[2022-07-07 03:19:21,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1596.7). Total num frames: 1515520. Throughput: 0: 3267.5. Samples: 3025664. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:19:21,870][16446] Avg episode reward: [(0, '3053.125')]
[2022-07-07 03:19:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1519616. Throughput: 0: 3264.7. Samples: 3046144. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:19:26,869][16446] Avg episode reward: [(0, '3058.966')]
[2022-07-07 03:19:31,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1531904. Throughput: 0: 3275.9. Samples: 3055552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:19:31,869][16446] Avg episode reward: [(0, '2970.339')]
[2022-07-07 03:19:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 1536000. Throughput: 0: 3262.4. Samples: 3075016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:19:36,869][16446] Avg episode reward: [(0, '2949.709')]
[2022-07-07 03:19:41,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1544192. Throughput: 0: 3231.5. Samples: 3094464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:19:41,868][16446] Avg episode reward: [(0, '2870.520')]
[2022-07-07 03:19:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1552384. Throughput: 0: 3244.6. Samples: 3104056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:19:46,869][16446] Avg episode reward: [(0, '2821.872')]
[2022-07-07 03:19:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1582.9). Total num frames: 1560576. Throughput: 0: 3189.9. Samples: 3122288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:19:51,869][16446] Avg episode reward: [(0, '2821.188')]
[2022-07-07 03:19:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1582.9). Total num frames: 1568768. Throughput: 0: 3215.1. Samples: 3142392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:19:56,869][16446] Avg episode reward: [(0, '2864.870')]
[2022-07-07 03:20:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1576960. Throughput: 0: 3241.1. Samples: 3152440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:20:01,868][16446] Avg episode reward: [(0, '2917.040')]
[2022-07-07 03:20:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1585152. Throughput: 0: 3213.4. Samples: 3170264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:20:06,869][16446] Avg episode reward: [(0, '2851.472')]
[2022-07-07 03:20:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1593344. Throughput: 0: 3190.4. Samples: 3189712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:20:11,869][16446] Avg episode reward: [(0, '2829.230')]
[2022-07-07 03:20:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1601536. Throughput: 0: 3210.0. Samples: 3200000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:20:16,869][16446] Avg episode reward: [(0, '2867.539')]
[2022-07-07 03:20:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1596.7). Total num frames: 1609728. Throughput: 0: 3203.7. Samples: 3219184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:20:21,869][16446] Avg episode reward: [(0, '2964.052')]
[2022-07-07 03:20:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1617920. Throughput: 0: 3158.6. Samples: 3236600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:20:26,869][16446] Avg episode reward: [(0, '2984.363')]
[2022-07-07 03:20:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 1626112. Throughput: 0: 3151.6. Samples: 3245880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:20:31,869][16446] Avg episode reward: [(0, '3029.017')]
[2022-07-07 03:20:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1634304. Throughput: 0: 3227.2. Samples: 3267512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:20:36,868][16446] Avg episode reward: [(0, '3058.429')]
[2022-07-07 03:20:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1642496. Throughput: 0: 3213.0. Samples: 3286976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:20:41,869][16446] Avg episode reward: [(0, '3036.980')]
[2022-07-07 03:20:46,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.3, 300 sec: 1596.7). Total num frames: 1650688. Throughput: 0: 3236.0. Samples: 3298064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:20:46,870][16446] Avg episode reward: [(0, '2998.213')]
[2022-07-07 03:20:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1658880. Throughput: 0: 3273.1. Samples: 3317552. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:20:51,869][16446] Avg episode reward: [(0, '3037.816')]
[2022-07-07 03:20:56,875][16446] Fps is (10 sec: 1637.6, 60 sec: 1638.2, 300 sec: 1596.7). Total num frames: 1667072. Throughput: 0: 3261.7. Samples: 3336512. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:20:56,875][16446] Avg episode reward: [(0, '3069.903')]
[2022-07-07 03:21:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1675264. Throughput: 0: 3256.0. Samples: 3346520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:21:01,869][16446] Avg episode reward: [(0, '3075.383')]
[2022-07-07 03:21:06,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1683456. Throughput: 0: 3246.4. Samples: 3365272. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:21:06,869][16446] Avg episode reward: [(0, '3093.941')]
[2022-07-07 03:21:11,873][16446] Fps is (10 sec: 1637.7, 60 sec: 1638.3, 300 sec: 1596.7). Total num frames: 1691648. Throughput: 0: 3297.3. Samples: 3384992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:21:11,873][16446] Avg episode reward: [(0, '3035.936')]
[2022-07-07 03:21:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1596.7). Total num frames: 1699840. Throughput: 0: 3325.0. Samples: 3395504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:21:16,869][16446] Avg episode reward: [(0, '3070.221')]
[2022-07-07 03:21:21,868][16446] Fps is (10 sec: 2048.9, 60 sec: 1706.7, 300 sec: 1610.6). Total num frames: 1712128. Throughput: 0: 3372.6. Samples: 3419280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:21:21,869][16446] Avg episode reward: [(0, '3052.756')]
[2022-07-07 03:21:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1610.6). Total num frames: 1720320. Throughput: 0: 3513.2. Samples: 3445072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:21:26,869][16446] Avg episode reward: [(0, '3168.516')]
[2022-07-07 03:21:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1638.4). Total num frames: 1732608. Throughput: 0: 3531.3. Samples: 3456968. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:21:31,868][16446] Avg episode reward: [(0, '3298.613')]
[2022-07-07 03:21:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1624.5). Total num frames: 1736704. Throughput: 0: 3575.1. Samples: 3478432. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:21:36,868][16446] Avg episode reward: [(0, '3322.793')]
[2022-07-07 03:21:41,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1706.7, 300 sec: 1624.5). Total num frames: 1744896. Throughput: 0: 3531.2. Samples: 3495392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:21:41,869][16446] Avg episode reward: [(0, '3282.363')]
[2022-07-07 03:21:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1775.0, 300 sec: 1638.4). Total num frames: 1757184. Throughput: 0: 3546.8. Samples: 3506128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:21:46,869][16446] Avg episode reward: [(0, '3299.020')]
[2022-07-07 03:21:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1638.4). Total num frames: 1765376. Throughput: 0: 3557.9. Samples: 3525376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:21:51,869][16446] Avg episode reward: [(0, '3249.660')]
[2022-07-07 03:21:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1775.1, 300 sec: 1638.4). Total num frames: 1773568. Throughput: 0: 3652.1. Samples: 3549320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:21:56,871][16446] Avg episode reward: [(0, '3368.877')]
[2022-07-07 03:22:01,871][16446] Fps is (10 sec: 2047.4, 60 sec: 1843.1, 300 sec: 1666.2). Total num frames: 1785856. Throughput: 0: 3729.4. Samples: 3563336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:22:01,871][16446] Avg episode reward: [(0, '3355.245')]
[2022-07-07 03:22:06,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1843.2, 300 sec: 1666.2). Total num frames: 1794048. Throughput: 0: 3671.5. Samples: 3584496. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:22:06,869][16446] Avg episode reward: [(0, '3353.943')]
[2022-07-07 03:22:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1843.3, 300 sec: 1666.2). Total num frames: 1802240. Throughput: 0: 3542.4. Samples: 3604480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:22:11,869][16446] Avg episode reward: [(0, '3312.223')]
[2022-07-07 03:22:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1666.2). Total num frames: 1810432. Throughput: 0: 3470.8. Samples: 3613152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:22:16,869][16446] Avg episode reward: [(0, '3301.973')]
[2022-07-07 03:22:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1666.2). Total num frames: 1818624. Throughput: 0: 3439.6. Samples: 3633216. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:22:21,869][16446] Avg episode reward: [(0, '3252.545')]
[2022-07-07 03:22:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1666.2). Total num frames: 1826816. Throughput: 0: 3516.4. Samples: 3653632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:22:26,869][16446] Avg episode reward: [(0, '3186.089')]
[2022-07-07 03:22:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 1835008. Throughput: 0: 3499.0. Samples: 3663584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:22:31,869][16446] Avg episode reward: [(0, '3252.132')]
[2022-07-07 03:22:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1666.2). Total num frames: 1843200. Throughput: 0: 3550.4. Samples: 3685144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:22:36,869][16446] Avg episode reward: [(0, '3292.819')]
[2022-07-07 03:22:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1666.2). Total num frames: 1851392. Throughput: 0: 3406.0. Samples: 3702592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:22:41,868][16446] Avg episode reward: [(0, '3320.963')]
[2022-07-07 03:22:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 1859584. Throughput: 0: 3304.6. Samples: 3712032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:22:46,869][16446] Avg episode reward: [(0, '3331.072')]
[2022-07-07 03:22:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 1867776. Throughput: 0: 3328.0. Samples: 3734256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:22:51,869][16446] Avg episode reward: [(0, '3459.829')]
[2022-07-07 03:22:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 1875968. Throughput: 0: 3303.6. Samples: 3753144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:22:56,869][16446] Avg episode reward: [(0, '3487.284')]
[2022-07-07 03:23:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1666.2). Total num frames: 1884160. Throughput: 0: 3397.0. Samples: 3766016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:23:01,869][16446] Avg episode reward: [(0, '3523.417')]
[2022-07-07 03:23:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1892352. Throughput: 0: 3363.4. Samples: 3784568. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:23:06,868][16446] Avg episode reward: [(0, '3414.410')]
[2022-07-07 03:23:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1900544. Throughput: 0: 3371.9. Samples: 3805368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:23:11,869][16446] Avg episode reward: [(0, '3477.171')]
[2022-07-07 03:23:16,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 1908736. Throughput: 0: 3394.1. Samples: 3816320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:16,869][16446] Avg episode reward: [(0, '3500.827')]
[2022-07-07 03:23:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1916928. Throughput: 0: 3304.4. Samples: 3833840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:21,869][16446] Avg episode reward: [(0, '3479.208')]
[2022-07-07 03:23:26,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.3, 300 sec: 1666.2). Total num frames: 1925120. Throughput: 0: 3346.0. Samples: 3853168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:26,875][16446] Avg episode reward: [(0, '3415.953')]
[2022-07-07 03:23:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 1933312. Throughput: 0: 3354.5. Samples: 3862984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:31,869][16446] Avg episode reward: [(0, '3467.034')]
[2022-07-07 03:23:36,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1941504. Throughput: 0: 3305.2. Samples: 3882992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:36,869][16446] Avg episode reward: [(0, '3470.844')]
[2022-07-07 03:23:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1949696. Throughput: 0: 3317.3. Samples: 3902424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:41,869][16446] Avg episode reward: [(0, '3424.923')]
[2022-07-07 03:23:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 1957888. Throughput: 0: 3258.3. Samples: 3912640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:46,869][16446] Avg episode reward: [(0, '3424.410')]
[2022-07-07 03:23:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1966080. Throughput: 0: 3277.5. Samples: 3932056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:51,869][16446] Avg episode reward: [(0, '3381.405')]
[2022-07-07 03:23:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1974272. Throughput: 0: 3297.1. Samples: 3953736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:23:56,869][16446] Avg episode reward: [(0, '3424.157')]
[2022-07-07 03:24:01,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1982464. Throughput: 0: 3287.7. Samples: 3964272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:01,870][16446] Avg episode reward: [(0, '3469.967')]
[2022-07-07 03:24:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 1990656. Throughput: 0: 3278.2. Samples: 3981360. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:24:06,869][16446] Avg episode reward: [(0, '3535.927')]
[2022-07-07 03:24:11,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 1998848. Throughput: 0: 3328.7. Samples: 4002952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:24:11,869][16446] Avg episode reward: [(0, '3525.727')]
[2022-07-07 03:24:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 2007040. Throughput: 0: 3349.3. Samples: 4013704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:24:16,869][16446] Avg episode reward: [(0, '3604.527')]
[2022-07-07 03:24:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2015232. Throughput: 0: 3302.9. Samples: 4031624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:24:21,869][16446] Avg episode reward: [(0, '3635.108')]
[2022-07-07 03:24:26,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 2023424. Throughput: 0: 3335.9. Samples: 4052544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:26,870][16446] Avg episode reward: [(0, '3657.642')]
[2022-07-07 03:24:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2031616. Throughput: 0: 3325.5. Samples: 4062288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:31,869][16446] Avg episode reward: [(0, '3712.642')]
[2022-07-07 03:24:36,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2039808. Throughput: 0: 3293.2. Samples: 4080248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:36,869][16446] Avg episode reward: [(0, '3810.400')]
[2022-07-07 03:24:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2048000. Throughput: 0: 3267.0. Samples: 4100752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:41,869][16446] Avg episode reward: [(0, '3866.892')]
[2022-07-07 03:24:46,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.3, 300 sec: 1680.0). Total num frames: 2056192. Throughput: 0: 3255.1. Samples: 4110752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:46,870][16446] Avg episode reward: [(0, '3922.260')]
[2022-07-07 03:24:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2064384. Throughput: 0: 3292.8. Samples: 4129536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:51,869][16446] Avg episode reward: [(0, '3932.374')]
[2022-07-07 03:24:56,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2072576. Throughput: 0: 3333.2. Samples: 4152944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:24:56,869][16446] Avg episode reward: [(0, '3941.468')]
[2022-07-07 03:25:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.4, 300 sec: 1680.0). Total num frames: 2080768. Throughput: 0: 3283.9. Samples: 4161488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:01,872][16446] Avg episode reward: [(0, '3936.332')]
[2022-07-07 03:25:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2088960. Throughput: 0: 3251.0. Samples: 4177920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:06,869][16446] Avg episode reward: [(0, '3924.197')]
[2022-07-07 03:25:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2097152. Throughput: 0: 3237.2. Samples: 4198216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:11,869][16446] Avg episode reward: [(0, '3903.533')]
[2022-07-07 03:25:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2105344. Throughput: 0: 3227.6. Samples: 4207528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:16,869][16446] Avg episode reward: [(0, '3861.984')]
[2022-07-07 03:25:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2113536. Throughput: 0: 3262.8. Samples: 4227072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:21,868][16446] Avg episode reward: [(0, '3906.100')]
[2022-07-07 03:25:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2121728. Throughput: 0: 3254.8. Samples: 4247216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:26,869][16446] Avg episode reward: [(0, '3935.633')]
[2022-07-07 03:25:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2129920. Throughput: 0: 3241.6. Samples: 4256616. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:25:31,869][16446] Avg episode reward: [(0, '3945.010')]
[2022-07-07 03:25:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2138112. Throughput: 0: 3252.4. Samples: 4275896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:25:36,869][16446] Avg episode reward: [(0, '3919.745')]
[2022-07-07 03:25:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2146304. Throughput: 0: 3122.8. Samples: 4293472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:41,869][16446] Avg episode reward: [(0, '3944.116')]
[2022-07-07 03:25:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1680.1). Total num frames: 2154496. Throughput: 0: 3169.5. Samples: 4304104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:25:46,869][16446] Avg episode reward: [(0, '3943.876')]
[2022-07-07 03:25:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2162688. Throughput: 0: 3271.5. Samples: 4325136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:25:51,869][16446] Avg episode reward: [(0, '4028.702')]
[2022-07-07 03:25:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2170880. Throughput: 0: 3195.2. Samples: 4342000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:25:56,869][16446] Avg episode reward: [(0, '4035.224')]
[2022-07-07 03:26:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1680.1). Total num frames: 2179072. Throughput: 0: 3214.0. Samples: 4352160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:01,869][16446] Avg episode reward: [(0, '4100.892')]
[2022-07-07 03:26:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2187264. Throughput: 0: 3198.4. Samples: 4371000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:06,869][16446] Avg episode reward: [(0, '4081.437')]
[2022-07-07 03:26:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 2195456. Throughput: 0: 3191.3. Samples: 4390824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:26:11,869][16446] Avg episode reward: [(0, '4112.566')]
[2022-07-07 03:26:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 2203648. Throughput: 0: 3166.4. Samples: 4399104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:26:16,869][16446] Avg episode reward: [(0, '4106.935')]
[2022-07-07 03:26:21,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 2207744. Throughput: 0: 3189.3. Samples: 4419416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:26:21,868][16446] Avg episode reward: [(0, '4086.270')]
[2022-07-07 03:26:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 2220032. Throughput: 0: 3250.7. Samples: 4439752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:26,869][16446] Avg episode reward: [(0, '4059.818')]
[2022-07-07 03:26:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 2224128. Throughput: 0: 3201.1. Samples: 4448152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:31,869][16446] Avg episode reward: [(0, '4093.590')]
[2022-07-07 03:26:36,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 2232320. Throughput: 0: 3163.6. Samples: 4467496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:36,869][16446] Avg episode reward: [(0, '4091.268')]
[2022-07-07 03:26:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 2240512. Throughput: 0: 3192.0. Samples: 4485640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:41,869][16446] Avg episode reward: [(0, '4043.193')]
[2022-07-07 03:26:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 2248704. Throughput: 0: 3182.4. Samples: 4495368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:46,869][16446] Avg episode reward: [(0, '4064.861')]
[2022-07-07 03:26:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 2256896. Throughput: 0: 3165.9. Samples: 4513464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:26:51,869][16446] Avg episode reward: [(0, '4069.978')]
[2022-07-07 03:26:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 2265088. Throughput: 0: 3096.7. Samples: 4530176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:26:56,869][16446] Avg episode reward: [(0, '4041.788')]
[2022-07-07 03:27:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 2273280. Throughput: 0: 3095.1. Samples: 4538384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:27:01,869][16446] Avg episode reward: [(0, '3945.270')]
[2022-07-07 03:27:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1501.9, 300 sec: 1610.6). Total num frames: 2277376. Throughput: 0: 3033.6. Samples: 4555928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:06,869][16446] Avg episode reward: [(0, '3925.142')]
[2022-07-07 03:27:11,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1501.9, 300 sec: 1610.6). Total num frames: 2285568. Throughput: 0: 3029.7. Samples: 4576088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:11,869][16446] Avg episode reward: [(0, '3858.424')]
[2022-07-07 03:27:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1501.9, 300 sec: 1610.6). Total num frames: 2293760. Throughput: 0: 3067.0. Samples: 4586168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:16,869][16446] Avg episode reward: [(0, '3855.123')]
[2022-07-07 03:27:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2301952. Throughput: 0: 3027.0. Samples: 4603712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:21,869][16446] Avg episode reward: [(0, '3783.043')]
[2022-07-07 03:27:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1501.9, 300 sec: 1610.6). Total num frames: 2310144. Throughput: 0: 3076.3. Samples: 4624072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:26,869][16446] Avg episode reward: [(0, '3869.068')]
[2022-07-07 03:27:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2318336. Throughput: 0: 3130.3. Samples: 4636232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:31,869][16446] Avg episode reward: [(0, '3841.530')]
[2022-07-07 03:27:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2326528. Throughput: 0: 3090.3. Samples: 4652528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:36,868][16446] Avg episode reward: [(0, '3821.188')]
[2022-07-07 03:27:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2334720. Throughput: 0: 3094.8. Samples: 4669440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:41,869][16446] Avg episode reward: [(0, '3894.500')]
[2022-07-07 03:27:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2342912. Throughput: 0: 3131.9. Samples: 4679320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:46,869][16446] Avg episode reward: [(0, '3905.697')]
[2022-07-07 03:27:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2351104. Throughput: 0: 3181.0. Samples: 4699072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:51,869][16446] Avg episode reward: [(0, '3930.989')]
[2022-07-07 03:27:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2359296. Throughput: 0: 3166.8. Samples: 4718592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:27:56,869][16446] Avg episode reward: [(0, '3955.558')]
[2022-07-07 03:28:01,874][16446] Fps is (10 sec: 1637.5, 60 sec: 1570.0, 300 sec: 1610.6). Total num frames: 2367488. Throughput: 0: 3156.2. Samples: 4728216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:01,874][16446] Avg episode reward: [(0, '4030.084')]
[2022-07-07 03:28:06,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2375680. Throughput: 0: 3186.9. Samples: 4747128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:06,870][16446] Avg episode reward: [(0, '4128.334')]
[2022-07-07 03:28:11,870][16446] Fps is (10 sec: 1639.1, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2383872. Throughput: 0: 3193.3. Samples: 4767776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:11,870][16446] Avg episode reward: [(0, '4145.033')]
[2022-07-07 03:28:16,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2392064. Throughput: 0: 3143.3. Samples: 4777680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:28:16,869][16446] Avg episode reward: [(0, '4147.895')]
[2022-07-07 03:28:21,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2400256. Throughput: 0: 3234.8. Samples: 4798096. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:28:21,869][16446] Avg episode reward: [(0, '4305.530')]
[2022-07-07 03:28:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2408448. Throughput: 0: 3309.2. Samples: 4818352. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:28:26,869][16446] Avg episode reward: [(0, '4258.147')]
[2022-07-07 03:28:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2416640. Throughput: 0: 3309.7. Samples: 4828256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:31,869][16446] Avg episode reward: [(0, '4266.360')]
[2022-07-07 03:28:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2424832. Throughput: 0: 3330.0. Samples: 4848920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:36,869][16446] Avg episode reward: [(0, '4279.816')]
[2022-07-07 03:28:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2433024. Throughput: 0: 3283.9. Samples: 4866368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:41,869][16446] Avg episode reward: [(0, '4284.878')]
[2022-07-07 03:28:46,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.3, 300 sec: 1610.6). Total num frames: 2441216. Throughput: 0: 3297.3. Samples: 4876584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:46,871][16446] Avg episode reward: [(0, '4249.435')]
[2022-07-07 03:28:51,871][16446] Fps is (10 sec: 1638.0, 60 sec: 1638.3, 300 sec: 1610.6). Total num frames: 2449408. Throughput: 0: 3355.8. Samples: 4898144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:51,871][16446] Avg episode reward: [(0, '4268.030')]
[2022-07-07 03:28:56,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2457600. Throughput: 0: 3300.0. Samples: 4916272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:28:56,869][16446] Avg episode reward: [(0, '4276.752')]
[2022-07-07 03:29:01,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1638.6, 300 sec: 1610.6). Total num frames: 2465792. Throughput: 0: 3301.9. Samples: 4926264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:29:01,869][16446] Avg episode reward: [(0, '4251.263')]
[2022-07-07 03:29:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2473984. Throughput: 0: 3309.3. Samples: 4947016. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:29:06,869][16446] Avg episode reward: [(0, '4182.748')]
[2022-07-07 03:29:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2482176. Throughput: 0: 3278.6. Samples: 4965888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:29:11,869][16446] Avg episode reward: [(0, '4161.885')]
[2022-07-07 03:29:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2490368. Throughput: 0: 3285.5. Samples: 4976104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:29:16,869][16446] Avg episode reward: [(0, '4195.215')]
[2022-07-07 03:29:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2498560. Throughput: 0: 3267.0. Samples: 4995936. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:29:21,869][16446] Avg episode reward: [(0, '4158.689')]
[2022-07-07 03:29:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2506752. Throughput: 0: 3336.9. Samples: 5016528. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:29:26,869][16446] Avg episode reward: [(0, '4253.052')]
[2022-07-07 03:29:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2514944. Throughput: 0: 3351.1. Samples: 5027376. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:29:31,869][16446] Avg episode reward: [(0, '4256.990')]
[2022-07-07 03:29:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2523136. Throughput: 0: 3309.2. Samples: 5047048. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:29:36,869][16446] Avg episode reward: [(0, '4239.943')]
[2022-07-07 03:29:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2531328. Throughput: 0: 3351.6. Samples: 5067096. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:29:41,869][16446] Avg episode reward: [(0, '4215.679')]
[2022-07-07 03:29:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1610.6). Total num frames: 2539520. Throughput: 0: 3337.1. Samples: 5076432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:29:46,869][16446] Avg episode reward: [(0, '4185.141')]
[2022-07-07 03:29:51,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2547712. Throughput: 0: 3295.9. Samples: 5095336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:29:51,870][16446] Avg episode reward: [(0, '4105.336')]
[2022-07-07 03:29:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2555904. Throughput: 0: 3313.2. Samples: 5114984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:29:56,869][16446] Avg episode reward: [(0, '4141.822')]
[2022-07-07 03:30:01,871][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.3, 300 sec: 1610.6). Total num frames: 2564096. Throughput: 0: 3310.2. Samples: 5125072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:01,871][16446] Avg episode reward: [(0, '4159.168')]
[2022-07-07 03:30:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2572288. Throughput: 0: 3289.2. Samples: 5143952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:06,869][16446] Avg episode reward: [(0, '4150.527')]
[2022-07-07 03:30:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2580480. Throughput: 0: 3237.0. Samples: 5162192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:11,869][16446] Avg episode reward: [(0, '4133.833')]
[2022-07-07 03:30:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2588672. Throughput: 0: 3195.9. Samples: 5171192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:16,869][16446] Avg episode reward: [(0, '4163.174')]
[2022-07-07 03:30:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2596864. Throughput: 0: 3196.1. Samples: 5190872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:21,869][16446] Avg episode reward: [(0, '4208.817')]
[2022-07-07 03:30:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2605056. Throughput: 0: 3166.8. Samples: 5209600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:26,869][16446] Avg episode reward: [(0, '4081.060')]
[2022-07-07 03:30:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2613248. Throughput: 0: 3162.8. Samples: 5218760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:31,869][16446] Avg episode reward: [(0, '4094.146')]
[2022-07-07 03:30:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2621440. Throughput: 0: 3228.0. Samples: 5240592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:36,869][16446] Avg episode reward: [(0, '4035.148')]
[2022-07-07 03:30:41,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1638.2, 300 sec: 1610.6). Total num frames: 2629632. Throughput: 0: 3222.6. Samples: 5260024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:41,875][16446] Avg episode reward: [(0, '3967.982')]
[2022-07-07 03:30:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2637824. Throughput: 0: 3204.1. Samples: 5269248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:46,869][16446] Avg episode reward: [(0, '3993.986')]
[2022-07-07 03:30:51,869][16446] Fps is (10 sec: 1639.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2646016. Throughput: 0: 3195.1. Samples: 5287736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:51,869][16446] Avg episode reward: [(0, '3975.928')]
[2022-07-07 03:30:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2654208. Throughput: 0: 3231.1. Samples: 5307592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:30:56,869][16446] Avg episode reward: [(0, '3942.787')]
[2022-07-07 03:31:01,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.5, 300 sec: 1610.6). Total num frames: 2662400. Throughput: 0: 3234.3. Samples: 5316736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:31:01,868][16446] Avg episode reward: [(0, '3935.839')]
[2022-07-07 03:31:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2670592. Throughput: 0: 3240.9. Samples: 5336712. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:31:06,869][16446] Avg episode reward: [(0, '3847.822')]
[2022-07-07 03:31:11,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1596.7). Total num frames: 2674688. Throughput: 0: 3271.1. Samples: 5356800. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:31:11,869][16446] Avg episode reward: [(0, '3780.469')]
[2022-07-07 03:31:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2686976. Throughput: 0: 3267.2. Samples: 5365784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:31:16,869][16446] Avg episode reward: [(0, '3857.606')]
[2022-07-07 03:31:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1610.6). Total num frames: 2695168. Throughput: 0: 3219.4. Samples: 5385464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:31:21,869][16446] Avg episode reward: [(0, '3858.840')]
[2022-07-07 03:31:26,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2699264. Throughput: 0: 3220.1. Samples: 5404904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:31:26,869][16446] Avg episode reward: [(0, '3889.429')]
[2022-07-07 03:31:31,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2707456. Throughput: 0: 3230.0. Samples: 5414600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:31:31,869][16446] Avg episode reward: [(0, '3975.385')]
[2022-07-07 03:31:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2715648. Throughput: 0: 3237.0. Samples: 5433400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:31:36,869][16446] Avg episode reward: [(0, '4063.505')]
[2022-07-07 03:31:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.3, 300 sec: 1610.6). Total num frames: 2723840. Throughput: 0: 3259.2. Samples: 5454256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:31:41,869][16446] Avg episode reward: [(0, '4057.143')]
[2022-07-07 03:31:46,872][16446] Fps is (10 sec: 1637.8, 60 sec: 1570.0, 300 sec: 1610.6). Total num frames: 2732032. Throughput: 0: 3269.4. Samples: 5463872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:31:46,872][16446] Avg episode reward: [(0, '4223.017')]
[2022-07-07 03:31:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1610.6). Total num frames: 2740224. Throughput: 0: 3246.0. Samples: 5482784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:31:51,869][16446] Avg episode reward: [(0, '4167.788')]
[2022-07-07 03:31:56,868][16446] Fps is (10 sec: 1639.0, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 2748416. Throughput: 0: 3238.2. Samples: 5502520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:31:56,869][16446] Avg episode reward: [(0, '4104.258')]
[2022-07-07 03:32:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 2756608. Throughput: 0: 3247.5. Samples: 5511920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:32:01,869][16446] Avg episode reward: [(0, '4056.766')]
[2022-07-07 03:32:06,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 2764800. Throughput: 0: 3202.2. Samples: 5529568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:32:06,871][16446] Avg episode reward: [(0, '4062.659')]
[2022-07-07 03:32:11,872][16446] Fps is (10 sec: 1637.7, 60 sec: 1638.3, 300 sec: 1624.5). Total num frames: 2772992. Throughput: 0: 3163.8. Samples: 5547288. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:32:11,873][16446] Avg episode reward: [(0, '4082.595')]
[2022-07-07 03:32:16,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 2781184. Throughput: 0: 3179.9. Samples: 5557696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:32:16,869][16446] Avg episode reward: [(0, '4039.392')]
[2022-07-07 03:32:21,868][16446] Fps is (10 sec: 1639.1, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 2789376. Throughput: 0: 3231.8. Samples: 5578832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:32:21,869][16446] Avg episode reward: [(0, '3991.482')]
[2022-07-07 03:32:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2797568. Throughput: 0: 3204.6. Samples: 5598464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:32:26,869][16446] Avg episode reward: [(0, '4003.710')]
[2022-07-07 03:32:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2805760. Throughput: 0: 3199.7. Samples: 5607848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:32:31,869][16446] Avg episode reward: [(0, '3973.473')]
[2022-07-07 03:32:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2813952. Throughput: 0: 3218.8. Samples: 5627632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:32:36,869][16446] Avg episode reward: [(0, '3944.115')]
[2022-07-07 03:32:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2822144. Throughput: 0: 3209.2. Samples: 5646936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:32:41,869][16446] Avg episode reward: [(0, '3952.886')]
[2022-07-07 03:32:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1624.5). Total num frames: 2830336. Throughput: 0: 3235.9. Samples: 5657536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:32:46,869][16446] Avg episode reward: [(0, '3988.262')]
[2022-07-07 03:32:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2838528. Throughput: 0: 3271.4. Samples: 5676776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:32:51,868][16446] Avg episode reward: [(0, '4064.644')]
[2022-07-07 03:32:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2846720. Throughput: 0: 3298.6. Samples: 5695712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:32:56,869][16446] Avg episode reward: [(0, '4229.775')]
[2022-07-07 03:33:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2854912. Throughput: 0: 3275.6. Samples: 5705096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:33:01,869][16446] Avg episode reward: [(0, '4291.612')]
[2022-07-07 03:33:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1624.5). Total num frames: 2863104. Throughput: 0: 3238.9. Samples: 5724584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:33:06,869][16446] Avg episode reward: [(0, '4315.016')]
[2022-07-07 03:33:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1624.5). Total num frames: 2871296. Throughput: 0: 3221.3. Samples: 5743424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:33:11,869][16446] Avg episode reward: [(0, '4305.853')]
[2022-07-07 03:33:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2879488. Throughput: 0: 3250.3. Samples: 5754112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:33:16,868][16446] Avg episode reward: [(0, '4378.421')]
[2022-07-07 03:33:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2887680. Throughput: 0: 3276.3. Samples: 5775064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:33:21,869][16446] Avg episode reward: [(0, '4399.054')]
[2022-07-07 03:33:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2895872. Throughput: 0: 3252.3. Samples: 5793288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:33:26,869][16446] Avg episode reward: [(0, '4362.016')]
[2022-07-07 03:33:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2904064. Throughput: 0: 3242.0. Samples: 5803424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:33:31,869][16446] Avg episode reward: [(0, '4380.639')]
[2022-07-07 03:33:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2912256. Throughput: 0: 3266.7. Samples: 5823776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:33:36,869][16446] Avg episode reward: [(0, '4336.054')]
[2022-07-07 03:33:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2920448. Throughput: 0: 3247.5. Samples: 5841848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:33:41,869][16446] Avg episode reward: [(0, '4367.938')]
[2022-07-07 03:33:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2928640. Throughput: 0: 3267.2. Samples: 5852120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:33:46,869][16446] Avg episode reward: [(0, '4301.812')]
[2022-07-07 03:33:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2936832. Throughput: 0: 3293.5. Samples: 5872792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:33:51,868][16446] Avg episode reward: [(0, '4295.542')]
[2022-07-07 03:33:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2945024. Throughput: 0: 3258.3. Samples: 5890048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:33:56,869][16446] Avg episode reward: [(0, '4274.047')]
[2022-07-07 03:34:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2953216. Throughput: 0: 3242.1. Samples: 5900008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:34:01,869][16446] Avg episode reward: [(0, '4243.540')]
[2022-07-07 03:34:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2961408. Throughput: 0: 3200.0. Samples: 5919064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:34:06,869][16446] Avg episode reward: [(0, '4214.349')]
[2022-07-07 03:34:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2969600. Throughput: 0: 3231.5. Samples: 5938704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:34:11,869][16446] Avg episode reward: [(0, '4224.205')]
[2022-07-07 03:34:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2977792. Throughput: 0: 3199.3. Samples: 5947392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:34:16,869][16446] Avg episode reward: [(0, '4161.020')]
[2022-07-07 03:34:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 2985984. Throughput: 0: 3218.1. Samples: 5968592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:34:21,869][16446] Avg episode reward: [(0, '4085.304')]
[2022-07-07 03:34:26,872][16446] Fps is (10 sec: 1637.7, 60 sec: 1638.3, 300 sec: 1624.5). Total num frames: 2994176. Throughput: 0: 3255.3. Samples: 5988352. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:34:26,873][16446] Avg episode reward: [(0, '4077.457')]
[2022-07-07 03:34:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3002368. Throughput: 0: 3221.5. Samples: 5997088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:34:31,869][16446] Avg episode reward: [(0, '4080.507')]
[2022-07-07 03:34:36,868][16446] Fps is (10 sec: 1639.1, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3010560. Throughput: 0: 3244.3. Samples: 6018784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:34:36,869][16446] Avg episode reward: [(0, '4015.195')]
[2022-07-07 03:34:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3018752. Throughput: 0: 3277.2. Samples: 6037520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:34:41,869][16446] Avg episode reward: [(0, '3996.851')]
[2022-07-07 03:34:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3026944. Throughput: 0: 3272.5. Samples: 6047272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:34:46,869][16446] Avg episode reward: [(0, '3905.939')]
[2022-07-07 03:34:51,892][16446] Fps is (10 sec: 1634.6, 60 sec: 1637.8, 300 sec: 1624.4). Total num frames: 3035136. Throughput: 0: 3287.7. Samples: 6067088. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:34:51,892][16446] Avg episode reward: [(0, '3979.385')]
[2022-07-07 03:34:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3043328. Throughput: 0: 3269.0. Samples: 6085808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:34:56,869][16446] Avg episode reward: [(0, '3971.604')]
[2022-07-07 03:35:01,871][16446] Fps is (10 sec: 1641.8, 60 sec: 1638.3, 300 sec: 1624.5). Total num frames: 3051520. Throughput: 0: 3273.4. Samples: 6094704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:35:01,871][16446] Avg episode reward: [(0, '3966.287')]
[2022-07-07 03:35:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 3055616. Throughput: 0: 3223.5. Samples: 6113648. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:35:06,869][16446] Avg episode reward: [(0, '4004.844')]
[2022-07-07 03:35:11,868][16446] Fps is (10 sec: 1229.1, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 3063808. Throughput: 0: 3201.0. Samples: 6132384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:35:11,869][16446] Avg episode reward: [(0, '3995.788')]
[2022-07-07 03:35:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 3072000. Throughput: 0: 3249.4. Samples: 6143312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:35:16,869][16446] Avg episode reward: [(0, '3978.185')]
[2022-07-07 03:35:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 3080192. Throughput: 0: 3154.8. Samples: 6160752. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:35:21,869][16446] Avg episode reward: [(0, '4050.253')]
[2022-07-07 03:35:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1610.6). Total num frames: 3088384. Throughput: 0: 3251.2. Samples: 6183824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:35:26,869][16446] Avg episode reward: [(0, '4084.162')]
[2022-07-07 03:35:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 3096576. Throughput: 0: 3239.3. Samples: 6193040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:35:31,869][16446] Avg episode reward: [(0, '4161.132')]
[2022-07-07 03:35:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1610.7). Total num frames: 3104768. Throughput: 0: 3193.3. Samples: 6210712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:35:36,869][16446] Avg episode reward: [(0, '4261.402')]
[2022-07-07 03:35:41,870][16446] Fps is (10 sec: 1638.0, 60 sec: 1570.1, 300 sec: 1610.6). Total num frames: 3112960. Throughput: 0: 3265.4. Samples: 6232760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:35:41,871][16446] Avg episode reward: [(0, '4311.034')]
[2022-07-07 03:35:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3125248. Throughput: 0: 3283.2. Samples: 6242440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:35:46,869][16446] Avg episode reward: [(0, '4334.314')]
[2022-07-07 03:35:51,868][16446] Fps is (10 sec: 2048.5, 60 sec: 1639.0, 300 sec: 1624.5). Total num frames: 3133440. Throughput: 0: 3379.4. Samples: 6265720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:35:51,869][16446] Avg episode reward: [(0, '4298.945')]
[2022-07-07 03:35:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3141632. Throughput: 0: 3366.9. Samples: 6283896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:35:56,869][16446] Avg episode reward: [(0, '4377.895')]
[2022-07-07 03:36:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1624.5). Total num frames: 3149824. Throughput: 0: 3357.0. Samples: 6294376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:36:01,869][16446] Avg episode reward: [(0, '4294.752')]
[2022-07-07 03:36:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 3158016. Throughput: 0: 3416.5. Samples: 6314496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:36:06,869][16446] Avg episode reward: [(0, '4302.134')]
[2022-07-07 03:36:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1624.5). Total num frames: 3166208. Throughput: 0: 3314.0. Samples: 6332952. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:36:11,869][16446] Avg episode reward: [(0, '4281.715')]
[2022-07-07 03:36:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1624.5). Total num frames: 3174400. Throughput: 0: 3325.9. Samples: 6342704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:36:16,869][16446] Avg episode reward: [(0, '4296.703')]
[2022-07-07 03:36:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 3182592. Throughput: 0: 3353.4. Samples: 6361616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:36:21,869][16446] Avg episode reward: [(0, '4202.746')]
[2022-07-07 03:36:26,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1638.4). Total num frames: 3190784. Throughput: 0: 3296.8. Samples: 6381112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:36:26,870][16446] Avg episode reward: [(0, '4127.979')]
[2022-07-07 03:36:31,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1638.4). Total num frames: 3198976. Throughput: 0: 3270.7. Samples: 6389624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:36:31,870][16446] Avg episode reward: [(0, '4104.206')]
[2022-07-07 03:36:36,868][16446] Fps is (10 sec: 1228.9, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3203072. Throughput: 0: 3203.7. Samples: 6409888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:36:36,869][16446] Avg episode reward: [(0, '4006.240')]
[2022-07-07 03:36:41,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 3215360. Throughput: 0: 3258.5. Samples: 6430528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:36:41,869][16446] Avg episode reward: [(0, '3909.912')]
[2022-07-07 03:36:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 3219456. Throughput: 0: 3210.8. Samples: 6438864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:36:46,869][16446] Avg episode reward: [(0, '3758.515')]
[2022-07-07 03:36:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3231744. Throughput: 0: 3228.1. Samples: 6459760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:36:51,869][16446] Avg episode reward: [(0, '3758.367')]
[2022-07-07 03:36:56,870][16446] Fps is (10 sec: 2047.5, 60 sec: 1638.3, 300 sec: 1638.4). Total num frames: 3239936. Throughput: 0: 3264.5. Samples: 6479864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:36:56,871][16446] Avg episode reward: [(0, '3756.382')]
[2022-07-07 03:37:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3248128. Throughput: 0: 3261.3. Samples: 6489464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:37:01,868][16446] Avg episode reward: [(0, '3844.129')]
[2022-07-07 03:37:06,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3256320. Throughput: 0: 3273.4. Samples: 6508920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:37:06,868][16446] Avg episode reward: [(0, '3816.671')]
[2022-07-07 03:37:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3264512. Throughput: 0: 3274.2. Samples: 6528448. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:37:11,874][16446] Avg episode reward: [(0, '3823.665')]
[2022-07-07 03:37:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3272704. Throughput: 0: 3310.5. Samples: 6538592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:37:16,869][16446] Avg episode reward: [(0, '3859.710')]
[2022-07-07 03:37:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3280896. Throughput: 0: 3342.4. Samples: 6560296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:37:21,869][16446] Avg episode reward: [(0, '3962.165')]
[2022-07-07 03:37:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3289088. Throughput: 0: 3343.5. Samples: 6580984. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:37:26,869][16446] Avg episode reward: [(0, '4001.347')]
[2022-07-07 03:37:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3297280. Throughput: 0: 3389.5. Samples: 6591392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:37:31,869][16446] Avg episode reward: [(0, '4121.651')]
[2022-07-07 03:37:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 3305472. Throughput: 0: 3352.5. Samples: 6610624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:37:36,869][16446] Avg episode reward: [(0, '4267.396')]
[2022-07-07 03:37:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3313664. Throughput: 0: 3312.0. Samples: 6628896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:37:41,869][16446] Avg episode reward: [(0, '4339.106')]
[2022-07-07 03:37:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 3321856. Throughput: 0: 3332.4. Samples: 6639424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:37:46,869][16446] Avg episode reward: [(0, '4376.914')]
[2022-07-07 03:37:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3330048. Throughput: 0: 3347.7. Samples: 6659568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:37:51,869][16446] Avg episode reward: [(0, '4396.957')]
[2022-07-07 03:37:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1638.4). Total num frames: 3338240. Throughput: 0: 3357.2. Samples: 6679520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:37:56,869][16446] Avg episode reward: [(0, '4424.634')]
[2022-07-07 03:38:01,871][16446] Fps is (10 sec: 1638.0, 60 sec: 1638.3, 300 sec: 1638.4). Total num frames: 3346432. Throughput: 0: 3368.7. Samples: 6690192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:01,871][16446] Avg episode reward: [(0, '4318.517')]
[2022-07-07 03:38:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3354624. Throughput: 0: 3299.2. Samples: 6708760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:06,869][16446] Avg episode reward: [(0, '4328.811')]
[2022-07-07 03:38:11,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3362816. Throughput: 0: 3229.2. Samples: 6726296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:11,869][16446] Avg episode reward: [(0, '4391.496')]
[2022-07-07 03:38:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3371008. Throughput: 0: 3247.3. Samples: 6737520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:16,869][16446] Avg episode reward: [(0, '4413.540')]
[2022-07-07 03:38:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3379200. Throughput: 0: 3283.9. Samples: 6758400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:21,869][16446] Avg episode reward: [(0, '4372.944')]
[2022-07-07 03:38:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3387392. Throughput: 0: 3330.1. Samples: 6778752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:26,869][16446] Avg episode reward: [(0, '4345.288')]
[2022-07-07 03:38:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3395584. Throughput: 0: 3353.4. Samples: 6790328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:31,869][16446] Avg episode reward: [(0, '4377.655')]
[2022-07-07 03:38:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3403776. Throughput: 0: 3308.3. Samples: 6808440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:36,868][16446] Avg episode reward: [(0, '4383.962')]
[2022-07-07 03:38:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3411968. Throughput: 0: 3328.9. Samples: 6829320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:41,869][16446] Avg episode reward: [(0, '4387.368')]
[2022-07-07 03:38:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3420160. Throughput: 0: 3325.5. Samples: 6839832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:38:46,869][16446] Avg episode reward: [(0, '4420.656')]
[2022-07-07 03:38:51,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3428352. Throughput: 0: 3312.7. Samples: 6857832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:38:51,869][16446] Avg episode reward: [(0, '4323.410')]
[2022-07-07 03:38:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3436544. Throughput: 0: 3335.3. Samples: 6876384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:38:56,869][16446] Avg episode reward: [(0, '4318.908')]
[2022-07-07 03:39:01,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.5, 300 sec: 1638.4). Total num frames: 3444736. Throughput: 0: 3341.5. Samples: 6887888. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:39:01,869][16446] Avg episode reward: [(0, '4282.639')]
[2022-07-07 03:39:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3452928. Throughput: 0: 3288.0. Samples: 6906360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:39:06,868][16446] Avg episode reward: [(0, '4231.611')]
[2022-07-07 03:39:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3461120. Throughput: 0: 3275.6. Samples: 6926152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:39:11,869][16446] Avg episode reward: [(0, '4193.262')]
[2022-07-07 03:39:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3469312. Throughput: 0: 3264.5. Samples: 6937232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:39:16,869][16446] Avg episode reward: [(0, '4218.345')]
[2022-07-07 03:39:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3477504. Throughput: 0: 3302.8. Samples: 6957064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:21,868][16446] Avg episode reward: [(0, '4282.958')]
[2022-07-07 03:39:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3485696. Throughput: 0: 3296.9. Samples: 6977680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:26,869][16446] Avg episode reward: [(0, '4274.238')]
[2022-07-07 03:39:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3493888. Throughput: 0: 3283.2. Samples: 6987576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:31,868][16446] Avg episode reward: [(0, '4277.948')]
[2022-07-07 03:39:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 3506176. Throughput: 0: 3318.4. Samples: 7007160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:36,869][16446] Avg episode reward: [(0, '4226.476')]
[2022-07-07 03:39:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 3514368. Throughput: 0: 3369.8. Samples: 7028024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:41,869][16446] Avg episode reward: [(0, '4233.174')]
[2022-07-07 03:39:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.4). Total num frames: 3522560. Throughput: 0: 3317.9. Samples: 7037192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:46,869][16446] Avg episode reward: [(0, '4417.883')]
[2022-07-07 03:39:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 3530752. Throughput: 0: 3358.2. Samples: 7057480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:51,869][16446] Avg episode reward: [(0, '4450.219')]
[2022-07-07 03:39:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 3538944. Throughput: 0: 3371.4. Samples: 7077864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:39:56,869][16446] Avg episode reward: [(0, '4505.549')]
[2022-07-07 03:40:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 3547136. Throughput: 0: 3331.0. Samples: 7087128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:01,869][16446] Avg episode reward: [(0, '4547.262')]
[2022-07-07 03:40:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 3555328. Throughput: 0: 3326.9. Samples: 7106776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:06,869][16446] Avg episode reward: [(0, '4549.404')]
[2022-07-07 03:40:11,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1706.6, 300 sec: 1666.2). Total num frames: 3563520. Throughput: 0: 3308.8. Samples: 7126584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:11,871][16446] Avg episode reward: [(0, '4455.836')]
[2022-07-07 03:40:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 3571712. Throughput: 0: 3297.4. Samples: 7135960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:16,869][16446] Avg episode reward: [(0, '4395.541')]
[2022-07-07 03:40:21,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 3579904. Throughput: 0: 3333.7. Samples: 7157176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:21,869][16446] Avg episode reward: [(0, '4337.714')]
[2022-07-07 03:40:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 3588096. Throughput: 0: 3280.9. Samples: 7175664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:26,869][16446] Avg episode reward: [(0, '4410.936')]
[2022-07-07 03:40:31,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3592192. Throughput: 0: 3269.0. Samples: 7184296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:31,869][16446] Avg episode reward: [(0, '4396.765')]
[2022-07-07 03:40:36,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 3600384. Throughput: 0: 3241.3. Samples: 7203336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:36,868][16446] Avg episode reward: [(0, '4230.550')]
[2022-07-07 03:40:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3608576. Throughput: 0: 3242.7. Samples: 7223784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:41,869][16446] Avg episode reward: [(0, '4217.987')]
[2022-07-07 03:40:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3620864. Throughput: 0: 3254.6. Samples: 7233584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:46,868][16446] Avg episode reward: [(0, '4110.240')]
[2022-07-07 03:40:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3624960. Throughput: 0: 3234.7. Samples: 7252336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:51,869][16446] Avg episode reward: [(0, '4193.739')]
[2022-07-07 03:40:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3637248. Throughput: 0: 3273.6. Samples: 7273888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:40:56,869][16446] Avg episode reward: [(0, '4192.058')]
[2022-07-07 03:41:01,885][16446] Fps is (10 sec: 2044.5, 60 sec: 1637.9, 300 sec: 1652.2). Total num frames: 3645440. Throughput: 0: 3258.8. Samples: 7282664. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:41:01,886][16446] Avg episode reward: [(0, '4048.956')]
[2022-07-07 03:41:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3649536. Throughput: 0: 3207.6. Samples: 7301520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:41:06,868][16446] Avg episode reward: [(0, '4078.417')]
[2022-07-07 03:41:11,875][16446] Fps is (10 sec: 1640.1, 60 sec: 1638.3, 300 sec: 1652.2). Total num frames: 3661824. Throughput: 0: 3266.0. Samples: 7322656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:41:11,875][16446] Avg episode reward: [(0, '4000.101')]
[2022-07-07 03:41:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3670016. Throughput: 0: 3278.8. Samples: 7331840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:41:16,869][16446] Avg episode reward: [(0, '4073.712')]
[2022-07-07 03:41:21,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3678208. Throughput: 0: 3293.2. Samples: 7351528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:41:21,868][16446] Avg episode reward: [(0, '4022.270')]
[2022-07-07 03:41:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3686400. Throughput: 0: 3294.6. Samples: 7372040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:41:26,869][16446] Avg episode reward: [(0, '4080.785')]
[2022-07-07 03:41:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 3694592. Throughput: 0: 3280.4. Samples: 7381200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:41:31,868][16446] Avg episode reward: [(0, '4079.305')]
[2022-07-07 03:41:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 3702784. Throughput: 0: 3348.4. Samples: 7403016. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:41:36,869][16446] Avg episode reward: [(0, '4099.566')]
[2022-07-07 03:41:41,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1666.2). Total num frames: 3710976. Throughput: 0: 3288.8. Samples: 7421888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:41:41,870][16446] Avg episode reward: [(0, '4121.391')]
[2022-07-07 03:41:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3719168. Throughput: 0: 3278.6. Samples: 7430144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:41:46,869][16446] Avg episode reward: [(0, '4166.724')]
[2022-07-07 03:41:51,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 3727360. Throughput: 0: 3375.8. Samples: 7453432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:41:51,868][16446] Avg episode reward: [(0, '4153.205')]
[2022-07-07 03:41:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3735552. Throughput: 0: 3299.3. Samples: 7471104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:41:56,869][16446] Avg episode reward: [(0, '4438.796')]
[2022-07-07 03:42:01,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.8, 300 sec: 1652.3). Total num frames: 3743744. Throughput: 0: 3296.0. Samples: 7480168. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:42:01,871][16446] Avg episode reward: [(0, '4433.798')]
[2022-07-07 03:42:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 3751936. Throughput: 0: 3293.0. Samples: 7499712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:42:06,869][16446] Avg episode reward: [(0, '4524.946')]
[2022-07-07 03:42:11,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.6, 300 sec: 1652.3). Total num frames: 3760128. Throughput: 0: 3286.2. Samples: 7519920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:42:11,869][16446] Avg episode reward: [(0, '4550.134')]
[2022-07-07 03:42:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3768320. Throughput: 0: 3272.2. Samples: 7528448. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:42:16,869][16446] Avg episode reward: [(0, '4552.948')]
[2022-07-07 03:42:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3776512. Throughput: 0: 3268.4. Samples: 7550096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:42:21,869][16446] Avg episode reward: [(0, '4650.335')]
[2022-07-07 03:42:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3784704. Throughput: 0: 3303.0. Samples: 7570520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:42:26,869][16446] Avg episode reward: [(0, '4703.984')]
[2022-07-07 03:42:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3792896. Throughput: 0: 3341.9. Samples: 7580528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:42:31,869][16446] Avg episode reward: [(0, '4786.909')]
[2022-07-07 03:42:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3801088. Throughput: 0: 3300.1. Samples: 7601936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:42:36,869][16446] Avg episode reward: [(0, '4838.056')]
[2022-07-07 03:42:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3809280. Throughput: 0: 3299.6. Samples: 7619584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:42:41,869][16446] Avg episode reward: [(0, '4877.402')]
[2022-07-07 03:42:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3817472. Throughput: 0: 3326.6. Samples: 7629856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:42:46,868][16446] Avg episode reward: [(0, '4872.876')]
[2022-07-07 03:42:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3825664. Throughput: 0: 3316.4. Samples: 7648952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:42:51,868][16446] Avg episode reward: [(0, '4820.316')]
[2022-07-07 03:42:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3833856. Throughput: 0: 3274.1. Samples: 7667256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:42:56,869][16446] Avg episode reward: [(0, '4815.667')]
[2022-07-07 03:43:01,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.2, 300 sec: 1638.4). Total num frames: 3837952. Throughput: 0: 3279.6. Samples: 7676032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:43:01,868][16446] Avg episode reward: [(0, '4809.891')]
[2022-07-07 03:43:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3846144. Throughput: 0: 3212.8. Samples: 7694672. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:43:06,869][16446] Avg episode reward: [(0, '4762.245')]
[2022-07-07 03:43:11,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3858432. Throughput: 0: 3174.9. Samples: 7713392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:43:11,869][16446] Avg episode reward: [(0, '4746.073')]
[2022-07-07 03:43:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3862528. Throughput: 0: 3205.9. Samples: 7724792. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:43:16,869][16446] Avg episode reward: [(0, '4764.365')]
[2022-07-07 03:43:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3874816. Throughput: 0: 3168.0. Samples: 7744496. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:43:21,876][16446] Avg episode reward: [(0, '4752.904')]
[2022-07-07 03:43:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3883008. Throughput: 0: 3249.4. Samples: 7765808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:43:26,869][16446] Avg episode reward: [(0, '4743.326')]
[2022-07-07 03:43:31,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3887104. Throughput: 0: 3207.8. Samples: 7774208. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:43:31,869][16446] Avg episode reward: [(0, '4706.168')]
[2022-07-07 03:43:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3899392. Throughput: 0: 3249.4. Samples: 7795176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:43:36,869][16446] Avg episode reward: [(0, '4622.865')]
[2022-07-07 03:43:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3907584. Throughput: 0: 3276.8. Samples: 7814712. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:43:41,869][16446] Avg episode reward: [(0, '4628.906')]
[2022-07-07 03:43:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3915776. Throughput: 0: 3293.1. Samples: 7824224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:43:46,869][16446] Avg episode reward: [(0, '4622.605')]
[2022-07-07 03:43:51,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3919872. Throughput: 0: 3295.1. Samples: 7842952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:43:51,869][16446] Avg episode reward: [(0, '4697.050')]
[2022-07-07 03:43:56,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 3932160. Throughput: 0: 3313.4. Samples: 7862496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:43:56,869][16446] Avg episode reward: [(0, '4651.595')]
[2022-07-07 03:44:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3936256. Throughput: 0: 3270.8. Samples: 7871976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:44:01,869][16446] Avg episode reward: [(0, '4687.304')]
[2022-07-07 03:44:06,868][16446] Fps is (10 sec: 1228.9, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3944448. Throughput: 0: 3228.6. Samples: 7889784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:44:06,869][16446] Avg episode reward: [(0, '4707.328')]
[2022-07-07 03:44:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3952640. Throughput: 0: 3198.6. Samples: 7909744. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:44:11,869][16446] Avg episode reward: [(0, '4705.532')]
[2022-07-07 03:44:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3960832. Throughput: 0: 3250.8. Samples: 7920496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:44:16,869][16446] Avg episode reward: [(0, '4635.515')]
[2022-07-07 03:44:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3969024. Throughput: 0: 3214.9. Samples: 7939848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:44:21,869][16446] Avg episode reward: [(0, '4612.091')]
[2022-07-07 03:44:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1638.4). Total num frames: 3977216. Throughput: 0: 3245.0. Samples: 7960736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:44:26,869][16446] Avg episode reward: [(0, '4607.934')]
[2022-07-07 03:44:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1624.5). Total num frames: 3985408. Throughput: 0: 3243.7. Samples: 7970192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:44:31,869][16446] Avg episode reward: [(0, '4575.079')]
[2022-07-07 03:44:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 3997696. Throughput: 0: 3272.9. Samples: 7990232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:44:36,868][16446] Avg episode reward: [(0, '4597.164')]
[2022-07-07 03:44:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4005888. Throughput: 0: 3309.9. Samples: 8011440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:44:41,869][16446] Avg episode reward: [(0, '4607.554')]
[2022-07-07 03:44:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4014080. Throughput: 0: 3307.0. Samples: 8020792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:44:46,869][16446] Avg episode reward: [(0, '4508.831')]
[2022-07-07 03:44:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4022272. Throughput: 0: 3415.1. Samples: 8043464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:44:51,868][16446] Avg episode reward: [(0, '4483.113')]
[2022-07-07 03:44:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4030464. Throughput: 0: 3358.4. Samples: 8060872. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:44:56,869][16446] Avg episode reward: [(0, '4435.129')]
[2022-07-07 03:45:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1706.6, 300 sec: 1638.4). Total num frames: 4038656. Throughput: 0: 3340.6. Samples: 8070832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:45:01,871][16446] Avg episode reward: [(0, '4398.185')]
[2022-07-07 03:45:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4046848. Throughput: 0: 3336.4. Samples: 8089984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:45:06,869][16446] Avg episode reward: [(0, '4376.120')]
[2022-07-07 03:45:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4055040. Throughput: 0: 3306.8. Samples: 8109544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:45:11,869][16446] Avg episode reward: [(0, '4411.639')]
[2022-07-07 03:45:16,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1706.6, 300 sec: 1638.4). Total num frames: 4063232. Throughput: 0: 3318.7. Samples: 8119544. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:45:16,871][16446] Avg episode reward: [(0, '4414.799')]
[2022-07-07 03:45:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4071424. Throughput: 0: 3304.7. Samples: 8138944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:45:21,869][16446] Avg episode reward: [(0, '4364.321')]
[2022-07-07 03:45:26,872][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.5, 300 sec: 1652.3). Total num frames: 4079616. Throughput: 0: 3279.0. Samples: 8159008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:45:26,873][16446] Avg episode reward: [(0, '4388.196')]
[2022-07-07 03:45:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 4087808. Throughput: 0: 3261.0. Samples: 8167536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:45:31,868][16446] Avg episode reward: [(0, '4399.658')]
[2022-07-07 03:45:36,868][16446] Fps is (10 sec: 1639.1, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4096000. Throughput: 0: 3225.9. Samples: 8188632. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:45:36,869][16446] Avg episode reward: [(0, '4417.544')]
[2022-07-07 03:45:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4104192. Throughput: 0: 3276.8. Samples: 8208328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:45:41,869][16446] Avg episode reward: [(0, '4536.737')]
[2022-07-07 03:45:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4112384. Throughput: 0: 3244.5. Samples: 8216824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:45:46,869][16446] Avg episode reward: [(0, '4576.673')]
[2022-07-07 03:45:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4120576. Throughput: 0: 3253.9. Samples: 8236408. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:45:51,871][16446] Avg episode reward: [(0, '4547.882')]
[2022-07-07 03:45:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.5). Total num frames: 4128768. Throughput: 0: 3259.9. Samples: 8256240. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:45:56,869][16446] Avg episode reward: [(0, '4577.530')]
[2022-07-07 03:46:01,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.2, 300 sec: 1638.4). Total num frames: 4132864. Throughput: 0: 3244.7. Samples: 8265544. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 03:46:01,869][16446] Avg episode reward: [(0, '4669.034')]
[2022-07-07 03:46:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1624.6). Total num frames: 4141056. Throughput: 0: 3213.7. Samples: 8283560. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:46:06,869][16446] Avg episode reward: [(0, '4677.310')]
[2022-07-07 03:46:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 4149248. Throughput: 0: 3222.2. Samples: 8303992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:46:11,869][16446] Avg episode reward: [(0, '4633.535')]
[2022-07-07 03:46:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1624.5). Total num frames: 4157440. Throughput: 0: 3267.4. Samples: 8314568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:46:16,868][16446] Avg episode reward: [(0, '4510.242')]
[2022-07-07 03:46:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.1, 300 sec: 1624.5). Total num frames: 4165632. Throughput: 0: 3172.5. Samples: 8331392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:46:21,869][16446] Avg episode reward: [(0, '4477.209')]
[2022-07-07 03:46:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1570.2, 300 sec: 1624.5). Total num frames: 4173824. Throughput: 0: 3210.7. Samples: 8352808. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:46:26,868][16446] Avg episode reward: [(0, '4469.142')]
[2022-07-07 03:46:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4186112. Throughput: 0: 3256.5. Samples: 8363368. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:46:31,869][16446] Avg episode reward: [(0, '4409.028')]
[2022-07-07 03:46:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4194304. Throughput: 0: 3292.5. Samples: 8384568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:46:36,870][16446] Avg episode reward: [(0, '4343.241')]
[2022-07-07 03:46:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4202496. Throughput: 0: 3305.4. Samples: 8404984. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:46:41,869][16446] Avg episode reward: [(0, '4248.719')]
[2022-07-07 03:46:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4210688. Throughput: 0: 3316.8. Samples: 8414800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:46:46,869][16446] Avg episode reward: [(0, '4283.030')]
[2022-07-07 03:46:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4218880. Throughput: 0: 3366.2. Samples: 8435040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:46:51,869][16446] Avg episode reward: [(0, '4298.572')]
[2022-07-07 03:46:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4227072. Throughput: 0: 3376.9. Samples: 8455952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:46:56,869][16446] Avg episode reward: [(0, '4283.329')]
[2022-07-07 03:47:01,874][16446] Fps is (10 sec: 1637.5, 60 sec: 1706.5, 300 sec: 1638.4). Total num frames: 4235264. Throughput: 0: 3351.9. Samples: 8465424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:47:01,874][16446] Avg episode reward: [(0, '4328.211')]
[2022-07-07 03:47:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4243456. Throughput: 0: 3390.8. Samples: 8483976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:47:06,869][16446] Avg episode reward: [(0, '4347.455')]
[2022-07-07 03:47:11,868][16446] Fps is (10 sec: 1639.3, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4251648. Throughput: 0: 3339.6. Samples: 8503088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:47:11,869][16446] Avg episode reward: [(0, '4450.663')]
[2022-07-07 03:47:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4259840. Throughput: 0: 3292.1. Samples: 8511512. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:47:16,869][16446] Avg episode reward: [(0, '4555.090')]
[2022-07-07 03:47:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4268032. Throughput: 0: 3281.1. Samples: 8532216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:47:21,869][16446] Avg episode reward: [(0, '4599.437')]
[2022-07-07 03:47:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1638.4). Total num frames: 4276224. Throughput: 0: 3277.0. Samples: 8552448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:47:26,869][16446] Avg episode reward: [(0, '4562.248')]
[2022-07-07 03:47:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4284416. Throughput: 0: 3280.9. Samples: 8562440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:47:31,869][16446] Avg episode reward: [(0, '4593.009')]
[2022-07-07 03:47:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4292608. Throughput: 0: 3302.2. Samples: 8583640. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:47:36,869][16446] Avg episode reward: [(0, '4621.704')]
[2022-07-07 03:47:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4300800. Throughput: 0: 3275.6. Samples: 8603352. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:47:41,869][16446] Avg episode reward: [(0, '4660.643')]
[2022-07-07 03:47:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4308992. Throughput: 0: 3290.5. Samples: 8613480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:47:46,869][16446] Avg episode reward: [(0, '4628.231')]
[2022-07-07 03:47:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4317184. Throughput: 0: 3291.2. Samples: 8632080. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:47:51,869][16446] Avg episode reward: [(0, '4626.841')]
[2022-07-07 03:47:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4325376. Throughput: 0: 3277.9. Samples: 8650592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:47:56,869][16446] Avg episode reward: [(0, '4699.219')]
[2022-07-07 03:48:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.6, 300 sec: 1652.3). Total num frames: 4333568. Throughput: 0: 3276.3. Samples: 8658944. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:48:01,869][16446] Avg episode reward: [(0, '4640.628')]
[2022-07-07 03:48:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4341760. Throughput: 0: 3263.6. Samples: 8679080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:48:06,869][16446] Avg episode reward: [(0, '4565.504')]
[2022-07-07 03:48:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4349952. Throughput: 0: 3267.9. Samples: 8699504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:48:11,869][16446] Avg episode reward: [(0, '4575.713')]
[2022-07-07 03:48:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4358144. Throughput: 0: 3253.9. Samples: 8708864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:48:16,869][16446] Avg episode reward: [(0, '4504.667')]
[2022-07-07 03:48:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4366336. Throughput: 0: 3215.1. Samples: 8728320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:48:21,869][16446] Avg episode reward: [(0, '4442.381')]
[2022-07-07 03:48:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4374528. Throughput: 0: 3237.0. Samples: 8749016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:48:26,869][16446] Avg episode reward: [(0, '4489.613')]
[2022-07-07 03:48:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4382720. Throughput: 0: 3234.5. Samples: 8759032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:48:31,869][16446] Avg episode reward: [(0, '4501.089')]
[2022-07-07 03:48:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4390912. Throughput: 0: 3296.0. Samples: 8780400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:48:36,869][16446] Avg episode reward: [(0, '4449.601')]
[2022-07-07 03:48:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4399104. Throughput: 0: 3324.4. Samples: 8800192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:48:41,869][16446] Avg episode reward: [(0, '4479.208')]
[2022-07-07 03:48:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4407296. Throughput: 0: 3407.1. Samples: 8812264. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:48:46,869][16446] Avg episode reward: [(0, '4432.965')]
[2022-07-07 03:48:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 4415488. Throughput: 0: 3375.5. Samples: 8830976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:48:51,869][16446] Avg episode reward: [(0, '4533.380')]
[2022-07-07 03:48:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4423680. Throughput: 0: 3408.0. Samples: 8852864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:48:56,869][16446] Avg episode reward: [(0, '4588.725')]
[2022-07-07 03:49:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 4435968. Throughput: 0: 3439.6. Samples: 8863648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:01,868][16446] Avg episode reward: [(0, '4622.683')]
[2022-07-07 03:49:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4440064. Throughput: 0: 3439.8. Samples: 8883112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:06,869][16446] Avg episode reward: [(0, '4619.711')]
[2022-07-07 03:49:11,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 4452352. Throughput: 0: 3433.6. Samples: 8903528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:11,869][16446] Avg episode reward: [(0, '4589.327')]
[2022-07-07 03:49:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 4456448. Throughput: 0: 3419.2. Samples: 8912896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:16,869][16446] Avg episode reward: [(0, '4608.076')]
[2022-07-07 03:49:21,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 4468736. Throughput: 0: 3390.0. Samples: 8932952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:21,868][16446] Avg episode reward: [(0, '4719.148')]
[2022-07-07 03:49:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 4476928. Throughput: 0: 3396.8. Samples: 8953048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:26,869][16446] Avg episode reward: [(0, '4694.676')]
[2022-07-07 03:49:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 4485120. Throughput: 0: 3328.5. Samples: 8962048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:31,869][16446] Avg episode reward: [(0, '4777.211')]
[2022-07-07 03:49:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 4493312. Throughput: 0: 3363.2. Samples: 8982320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:36,869][16446] Avg episode reward: [(0, '4724.856')]
[2022-07-07 03:49:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 4501504. Throughput: 0: 3321.6. Samples: 9002336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:41,869][16446] Avg episode reward: [(0, '4767.437')]
[2022-07-07 03:49:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 4509696. Throughput: 0: 3281.8. Samples: 9011328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:46,869][16446] Avg episode reward: [(0, '4696.259')]
[2022-07-07 03:49:51,874][16446] Fps is (10 sec: 1637.4, 60 sec: 1706.5, 300 sec: 1652.3). Total num frames: 4517888. Throughput: 0: 3328.3. Samples: 9032904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:51,874][16446] Avg episode reward: [(0, '4687.975')]
[2022-07-07 03:49:56,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1666.2). Total num frames: 4530176. Throughput: 0: 3537.8. Samples: 9062728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:49:56,869][16446] Avg episode reward: [(0, '4609.510')]
[2022-07-07 03:50:01,868][16446] Fps is (10 sec: 2459.0, 60 sec: 1774.9, 300 sec: 1680.1). Total num frames: 4542464. Throughput: 0: 3643.7. Samples: 9076864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:01,869][16446] Avg episode reward: [(0, '4683.788')]
[2022-07-07 03:50:06,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1843.2, 300 sec: 1680.1). Total num frames: 4550656. Throughput: 0: 3741.3. Samples: 9101312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:06,868][16446] Avg episode reward: [(0, '4622.957')]
[2022-07-07 03:50:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1680.1). Total num frames: 4558848. Throughput: 0: 3748.1. Samples: 9121712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:11,868][16446] Avg episode reward: [(0, '4557.169')]
[2022-07-07 03:50:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1680.1). Total num frames: 4567040. Throughput: 0: 3773.3. Samples: 9131848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:16,868][16446] Avg episode reward: [(0, '4554.742')]
[2022-07-07 03:50:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1843.2, 300 sec: 1694.0). Total num frames: 4579328. Throughput: 0: 3842.1. Samples: 9155216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:21,869][16446] Avg episode reward: [(0, '4549.680')]
[2022-07-07 03:50:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1843.2, 300 sec: 1693.9). Total num frames: 4587520. Throughput: 0: 3832.9. Samples: 9174816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:26,869][16446] Avg episode reward: [(0, '4498.451')]
[2022-07-07 03:50:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1693.9). Total num frames: 4595712. Throughput: 0: 3821.3. Samples: 9183288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:31,868][16446] Avg episode reward: [(0, '4572.504')]
[2022-07-07 03:50:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1693.9). Total num frames: 4603904. Throughput: 0: 3884.6. Samples: 9207688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:36,869][16446] Avg episode reward: [(0, '4627.127')]
[2022-07-07 03:50:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1911.5, 300 sec: 1707.8). Total num frames: 4616192. Throughput: 0: 3830.2. Samples: 9235088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:41,869][16446] Avg episode reward: [(0, '4655.257')]
[2022-07-07 03:50:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1911.5, 300 sec: 1707.8). Total num frames: 4624384. Throughput: 0: 3812.4. Samples: 9248424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:46,869][16446] Avg episode reward: [(0, '4666.081')]
[2022-07-07 03:50:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1911.7, 300 sec: 1707.8). Total num frames: 4632576. Throughput: 0: 3663.3. Samples: 9266160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:50:51,869][16446] Avg episode reward: [(0, '4614.677')]
[2022-07-07 03:50:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1721.7). Total num frames: 4640768. Throughput: 0: 3680.5. Samples: 9287336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:50:56,868][16446] Avg episode reward: [(0, '4586.658')]
[2022-07-07 03:51:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1774.8, 300 sec: 1721.7). Total num frames: 4648960. Throughput: 0: 3688.3. Samples: 9297832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:51:01,871][16446] Avg episode reward: [(0, '4586.047')]
[2022-07-07 03:51:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 4657152. Throughput: 0: 3577.6. Samples: 9316208. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:51:06,869][16446] Avg episode reward: [(0, '4673.924')]
[2022-07-07 03:51:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 4665344. Throughput: 0: 3603.7. Samples: 9336984. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:51:11,869][16446] Avg episode reward: [(0, '4608.705')]
[2022-07-07 03:51:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 4673536. Throughput: 0: 3635.0. Samples: 9346864. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:51:16,869][16446] Avg episode reward: [(0, '4632.602')]
[2022-07-07 03:51:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4681728. Throughput: 0: 3537.4. Samples: 9366872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:51:21,868][16446] Avg episode reward: [(0, '4564.465')]
[2022-07-07 03:51:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 4694016. Throughput: 0: 3394.7. Samples: 9387848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:51:26,869][16446] Avg episode reward: [(0, '4602.810')]
[2022-07-07 03:51:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 4698112. Throughput: 0: 3284.4. Samples: 9396224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:51:31,869][16446] Avg episode reward: [(0, '4528.774')]
[2022-07-07 03:51:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 4710400. Throughput: 0: 3315.6. Samples: 9415360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:51:36,869][16446] Avg episode reward: [(0, '4419.141')]
[2022-07-07 03:51:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 4714496. Throughput: 0: 3302.0. Samples: 9435928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:51:41,869][16446] Avg episode reward: [(0, '4439.283')]
[2022-07-07 03:51:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4726784. Throughput: 0: 3278.6. Samples: 9445360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:51:46,869][16446] Avg episode reward: [(0, '4410.520')]
[2022-07-07 03:51:51,870][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 4730880. Throughput: 0: 3322.6. Samples: 9465728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:51:51,870][16446] Avg episode reward: [(0, '4468.819')]
[2022-07-07 03:51:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4743168. Throughput: 0: 3315.0. Samples: 9486160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:51:56,869][16446] Avg episode reward: [(0, '4436.897')]
[2022-07-07 03:52:01,871][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 4747264. Throughput: 0: 3283.7. Samples: 9494640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:01,872][16446] Avg episode reward: [(0, '4443.058')]
[2022-07-07 03:52:06,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1706.6, 300 sec: 1721.7). Total num frames: 4759552. Throughput: 0: 3284.0. Samples: 9514656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:06,870][16446] Avg episode reward: [(0, '4446.830')]
[2022-07-07 03:52:11,868][16446] Fps is (10 sec: 2048.6, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4767744. Throughput: 0: 3280.9. Samples: 9535488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:11,869][16446] Avg episode reward: [(0, '4401.903')]
[2022-07-07 03:52:16,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4775936. Throughput: 0: 3306.1. Samples: 9545000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:16,869][16446] Avg episode reward: [(0, '4468.240')]
[2022-07-07 03:52:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4784128. Throughput: 0: 3392.4. Samples: 9568016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:21,869][16446] Avg episode reward: [(0, '4525.082')]
[2022-07-07 03:52:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4792320. Throughput: 0: 3348.8. Samples: 9586624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:26,869][16446] Avg episode reward: [(0, '4587.682')]
[2022-07-07 03:52:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4800512. Throughput: 0: 3354.3. Samples: 9596304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:31,868][16446] Avg episode reward: [(0, '4664.237')]
[2022-07-07 03:52:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4808704. Throughput: 0: 3353.7. Samples: 9616640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:36,869][16446] Avg episode reward: [(0, '4709.128')]
[2022-07-07 03:52:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4816896. Throughput: 0: 3317.0. Samples: 9635424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:41,869][16446] Avg episode reward: [(0, '4732.587')]
[2022-07-07 03:52:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4825088. Throughput: 0: 3341.0. Samples: 9644976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:46,869][16446] Avg episode reward: [(0, '4740.505')]
[2022-07-07 03:52:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4833280. Throughput: 0: 3355.1. Samples: 9665632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:52:51,869][16446] Avg episode reward: [(0, '4725.271')]
[2022-07-07 03:52:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4841472. Throughput: 0: 3279.3. Samples: 9683056. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:52:56,869][16446] Avg episode reward: [(0, '4798.665')]
[2022-07-07 03:53:01,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1706.6, 300 sec: 1721.7). Total num frames: 4849664. Throughput: 0: 3288.0. Samples: 9692984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:53:01,875][16446] Avg episode reward: [(0, '4861.211')]
[2022-07-07 03:53:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4857856. Throughput: 0: 3195.2. Samples: 9711800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:53:06,868][16446] Avg episode reward: [(0, '4907.001')]
[2022-07-07 03:53:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4866048. Throughput: 0: 3230.2. Samples: 9731984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 03:53:11,869][16446] Avg episode reward: [(0, '4941.099')]
[2022-07-07 03:53:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4874240. Throughput: 0: 3228.8. Samples: 9741600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:53:16,869][16446] Avg episode reward: [(0, '4948.054')]
[2022-07-07 03:53:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4882432. Throughput: 0: 3245.2. Samples: 9762672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:53:21,869][16446] Avg episode reward: [(0, '4951.631')]
[2022-07-07 03:53:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4890624. Throughput: 0: 3241.1. Samples: 9781272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:53:26,869][16446] Avg episode reward: [(0, '4999.400')]
[2022-07-07 03:53:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4898816. Throughput: 0: 3296.0. Samples: 9793296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:53:31,869][16446] Avg episode reward: [(0, '4960.371')]
[2022-07-07 03:53:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4907008. Throughput: 0: 3297.4. Samples: 9814016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:53:36,869][16446] Avg episode reward: [(0, '4946.512')]
[2022-07-07 03:53:41,870][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4915200. Throughput: 0: 3376.6. Samples: 9835008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:53:41,870][16446] Avg episode reward: [(0, '4873.609')]
[2022-07-07 03:53:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4923392. Throughput: 0: 3385.4. Samples: 9845304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 03:53:46,869][16446] Avg episode reward: [(0, '4838.746')]
[2022-07-07 03:53:51,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4931584. Throughput: 0: 3400.0. Samples: 9864800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:53:51,869][16446] Avg episode reward: [(0, '4836.197')]
[2022-07-07 03:53:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 4939776. Throughput: 0: 3381.5. Samples: 9884152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:53:56,870][16446] Avg episode reward: [(0, '4814.788')]
[2022-07-07 03:54:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.6, 300 sec: 1721.7). Total num frames: 4947968. Throughput: 0: 3394.8. Samples: 9894368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:54:01,869][16446] Avg episode reward: [(0, '4726.263')]
[2022-07-07 03:54:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 4956160. Throughput: 0: 3325.5. Samples: 9912320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:54:06,868][16446] Avg episode reward: [(0, '4725.776')]
[2022-07-07 03:54:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 4964352. Throughput: 0: 3392.5. Samples: 9933936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:54:11,869][16446] Avg episode reward: [(0, '4773.374')]
[2022-07-07 03:54:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 4972544. Throughput: 0: 3352.4. Samples: 9944152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:54:16,869][16446] Avg episode reward: [(0, '4739.312')]
[2022-07-07 03:54:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 4980736. Throughput: 0: 3338.7. Samples: 9964256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:54:21,869][16446] Avg episode reward: [(0, '4765.285')]
[2022-07-07 03:54:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 4993024. Throughput: 0: 3329.4. Samples: 9984824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:54:26,869][16446] Avg episode reward: [(0, '4807.575')]
[2022-07-07 03:54:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 5001216. Throughput: 0: 3309.2. Samples: 9994216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:54:31,868][16446] Avg episode reward: [(0, '4796.950')]
[2022-07-07 03:54:36,871][16446] Fps is (10 sec: 1228.4, 60 sec: 1638.3, 300 sec: 1707.8). Total num frames: 5005312. Throughput: 0: 3320.8. Samples: 10014248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:54:36,872][16446] Avg episode reward: [(0, '4802.524')]
[2022-07-07 03:54:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 5017600. Throughput: 0: 3347.7. Samples: 10034800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:54:41,868][16446] Avg episode reward: [(0, '4835.729')]
[2022-07-07 03:54:46,868][16446] Fps is (10 sec: 2048.6, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 5025792. Throughput: 0: 3311.6. Samples: 10043392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:54:46,868][16446] Avg episode reward: [(0, '4866.278')]
[2022-07-07 03:54:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 5033984. Throughput: 0: 3356.1. Samples: 10063344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:54:51,869][16446] Avg episode reward: [(0, '4898.946')]
[2022-07-07 03:54:56,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1706.6, 300 sec: 1693.9). Total num frames: 5042176. Throughput: 0: 3342.5. Samples: 10084352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:54:56,870][16446] Avg episode reward: [(0, '4876.877')]
[2022-07-07 03:55:01,873][16446] Fps is (10 sec: 1637.6, 60 sec: 1706.5, 300 sec: 1693.9). Total num frames: 5050368. Throughput: 0: 3347.6. Samples: 10094808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:01,873][16446] Avg episode reward: [(0, '4878.462')]
[2022-07-07 03:55:06,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5058560. Throughput: 0: 3356.3. Samples: 10115288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:06,869][16446] Avg episode reward: [(0, '4878.789')]
[2022-07-07 03:55:11,868][16446] Fps is (10 sec: 1639.2, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5066752. Throughput: 0: 3311.5. Samples: 10133840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:11,869][16446] Avg episode reward: [(0, '4866.527')]
[2022-07-07 03:55:16,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1680.0). Total num frames: 5074944. Throughput: 0: 3345.5. Samples: 10144768. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:55:16,870][16446] Avg episode reward: [(0, '4840.756')]
[2022-07-07 03:55:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5083136. Throughput: 0: 3372.5. Samples: 10166000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:55:21,868][16446] Avg episode reward: [(0, '4637.952')]
[2022-07-07 03:55:26,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5091328. Throughput: 0: 3363.2. Samples: 10186144. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 03:55:26,869][16446] Avg episode reward: [(0, '4588.052')]
[2022-07-07 03:55:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5099520. Throughput: 0: 3431.8. Samples: 10197824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:31,869][16446] Avg episode reward: [(0, '4640.867')]
[2022-07-07 03:55:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.8, 300 sec: 1666.2). Total num frames: 5107712. Throughput: 0: 3379.2. Samples: 10215408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:36,869][16446] Avg episode reward: [(0, '4726.806')]
[2022-07-07 03:55:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5115904. Throughput: 0: 3380.0. Samples: 10236448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:41,869][16446] Avg episode reward: [(0, '4712.532')]
[2022-07-07 03:55:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5124096. Throughput: 0: 3389.3. Samples: 10247312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:46,869][16446] Avg episode reward: [(0, '4684.194')]
[2022-07-07 03:55:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5132288. Throughput: 0: 3325.7. Samples: 10264944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:51,870][16446] Avg episode reward: [(0, '4722.589')]
[2022-07-07 03:55:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5140480. Throughput: 0: 3346.8. Samples: 10284448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:55:56,869][16446] Avg episode reward: [(0, '4726.910')]
[2022-07-07 03:56:01,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.5, 300 sec: 1666.2). Total num frames: 5148672. Throughput: 0: 3329.2. Samples: 10294584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:56:01,870][16446] Avg episode reward: [(0, '4725.413')]
[2022-07-07 03:56:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5156864. Throughput: 0: 3282.8. Samples: 10313728. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:56:06,869][16446] Avg episode reward: [(0, '4674.314')]
[2022-07-07 03:56:11,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5165056. Throughput: 0: 3357.5. Samples: 10337232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:56:11,869][16446] Avg episode reward: [(0, '4618.079')]
[2022-07-07 03:56:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5173248. Throughput: 0: 3289.1. Samples: 10345832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:56:16,869][16446] Avg episode reward: [(0, '4752.151')]
[2022-07-07 03:56:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 5185536. Throughput: 0: 3364.6. Samples: 10366816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:56:21,869][16446] Avg episode reward: [(0, '4837.748')]
[2022-07-07 03:56:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 5189632. Throughput: 0: 3334.9. Samples: 10386520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:56:26,869][16446] Avg episode reward: [(0, '4773.124')]
[2022-07-07 03:56:31,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 5197824. Throughput: 0: 3296.4. Samples: 10395648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:56:31,868][16446] Avg episode reward: [(0, '4780.842')]
[2022-07-07 03:56:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5210112. Throughput: 0: 3328.0. Samples: 10414704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:56:36,868][16446] Avg episode reward: [(0, '4750.966')]
[2022-07-07 03:56:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 5218304. Throughput: 0: 3362.0. Samples: 10435736. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:56:41,869][16446] Avg episode reward: [(0, '4716.276')]
[2022-07-07 03:56:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5226496. Throughput: 0: 3345.7. Samples: 10445136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:56:46,869][16446] Avg episode reward: [(0, '4725.067')]
[2022-07-07 03:56:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 5234688. Throughput: 0: 3430.6. Samples: 10468104. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:56:51,868][16446] Avg episode reward: [(0, '4820.237')]
[2022-07-07 03:56:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5242880. Throughput: 0: 3378.3. Samples: 10489256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:56:56,869][16446] Avg episode reward: [(0, '4820.786')]
[2022-07-07 03:57:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1706.6, 300 sec: 1666.2). Total num frames: 5251072. Throughput: 0: 3434.6. Samples: 10500400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:01,872][16446] Avg episode reward: [(0, '4923.561')]
[2022-07-07 03:57:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 5259264. Throughput: 0: 3349.9. Samples: 10517560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:06,868][16446] Avg episode reward: [(0, '4872.195')]
[2022-07-07 03:57:11,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 5267456. Throughput: 0: 3361.6. Samples: 10537792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:11,869][16446] Avg episode reward: [(0, '4876.004')]
[2022-07-07 03:57:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 5275648. Throughput: 0: 3443.5. Samples: 10550608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:16,869][16446] Avg episode reward: [(0, '4839.669')]
[2022-07-07 03:57:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5287936. Throughput: 0: 3409.4. Samples: 10568128. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:57:21,868][16446] Avg episode reward: [(0, '4881.697')]
[2022-07-07 03:57:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 5292032. Throughput: 0: 3451.4. Samples: 10591048. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:57:26,869][16446] Avg episode reward: [(0, '4829.141')]
[2022-07-07 03:57:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1680.1). Total num frames: 5304320. Throughput: 0: 3451.4. Samples: 10600448. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:57:31,869][16446] Avg episode reward: [(0, '4846.286')]
[2022-07-07 03:57:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5312512. Throughput: 0: 3414.6. Samples: 10621760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:36,869][16446] Avg episode reward: [(0, '4887.132')]
[2022-07-07 03:57:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5320704. Throughput: 0: 3378.7. Samples: 10641296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:41,869][16446] Avg episode reward: [(0, '4827.714')]
[2022-07-07 03:57:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5328896. Throughput: 0: 3315.8. Samples: 10649600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:46,869][16446] Avg episode reward: [(0, '4801.729')]
[2022-07-07 03:57:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5337088. Throughput: 0: 3385.1. Samples: 10669888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:51,868][16446] Avg episode reward: [(0, '4747.830')]
[2022-07-07 03:57:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5345280. Throughput: 0: 3394.0. Samples: 10690520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:57:56,869][16446] Avg episode reward: [(0, '4752.628')]
[2022-07-07 03:58:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5353472. Throughput: 0: 3334.6. Samples: 10700664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:58:01,869][16446] Avg episode reward: [(0, '4696.306')]
[2022-07-07 03:58:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5361664. Throughput: 0: 3390.8. Samples: 10720712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:58:06,869][16446] Avg episode reward: [(0, '4660.923')]
[2022-07-07 03:58:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5369856. Throughput: 0: 3303.5. Samples: 10739704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:58:11,869][16446] Avg episode reward: [(0, '4670.349')]
[2022-07-07 03:58:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5378048. Throughput: 0: 3333.5. Samples: 10750456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:58:16,869][16446] Avg episode reward: [(0, '4670.648')]
[2022-07-07 03:58:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5386240. Throughput: 0: 3351.5. Samples: 10772576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:58:21,869][16446] Avg episode reward: [(0, '4670.926')]
[2022-07-07 03:58:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5394432. Throughput: 0: 3414.6. Samples: 10794952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:58:26,869][16446] Avg episode reward: [(0, '4642.951')]
[2022-07-07 03:58:31,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.3, 300 sec: 1680.0). Total num frames: 5402624. Throughput: 0: 3443.2. Samples: 10804552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 03:58:31,870][16446] Avg episode reward: [(0, '4597.579')]
[2022-07-07 03:58:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5410816. Throughput: 0: 3410.7. Samples: 10823368. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:58:36,869][16446] Avg episode reward: [(0, '4632.956')]
[2022-07-07 03:58:41,868][16446] Fps is (10 sec: 2048.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5423104. Throughput: 0: 3433.8. Samples: 10845040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:58:41,869][16446] Avg episode reward: [(0, '4648.291')]
[2022-07-07 03:58:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5427200. Throughput: 0: 3427.9. Samples: 10854920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:58:46,869][16446] Avg episode reward: [(0, '4633.049')]
[2022-07-07 03:58:51,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5435392. Throughput: 0: 3390.8. Samples: 10873296. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 03:58:51,868][16446] Avg episode reward: [(0, '4582.326')]
[2022-07-07 03:58:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5443584. Throughput: 0: 3372.3. Samples: 10891456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:58:56,869][16446] Avg episode reward: [(0, '4683.106')]
[2022-07-07 03:59:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5451776. Throughput: 0: 3386.1. Samples: 10902832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:01,869][16446] Avg episode reward: [(0, '4645.639')]
[2022-07-07 03:59:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5459968. Throughput: 0: 3291.9. Samples: 10920712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:06,869][16446] Avg episode reward: [(0, '4713.496')]
[2022-07-07 03:59:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5468160. Throughput: 0: 3254.8. Samples: 10941416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:11,868][16446] Avg episode reward: [(0, '4720.393')]
[2022-07-07 03:59:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5480448. Throughput: 0: 3290.6. Samples: 10952624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:16,869][16446] Avg episode reward: [(0, '4752.370')]
[2022-07-07 03:59:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5488640. Throughput: 0: 3328.9. Samples: 10973168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:21,869][16446] Avg episode reward: [(0, '4760.482')]
[2022-07-07 03:59:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5496832. Throughput: 0: 3342.6. Samples: 10995456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:26,869][16446] Avg episode reward: [(0, '4711.180')]
[2022-07-07 03:59:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1694.0). Total num frames: 5505024. Throughput: 0: 3341.9. Samples: 11005304. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:31,869][16446] Avg episode reward: [(0, '4681.380')]
[2022-07-07 03:59:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5513216. Throughput: 0: 3390.6. Samples: 11025872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:36,868][16446] Avg episode reward: [(0, '4660.218')]
[2022-07-07 03:59:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5521408. Throughput: 0: 3434.3. Samples: 11046000. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:41,869][16446] Avg episode reward: [(0, '4718.592')]
[2022-07-07 03:59:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5529600. Throughput: 0: 3437.9. Samples: 11057536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 03:59:46,869][16446] Avg episode reward: [(0, '4797.280')]
[2022-07-07 03:59:51,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1706.6, 300 sec: 1680.1). Total num frames: 5537792. Throughput: 0: 3439.3. Samples: 11075488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:59:51,871][16446] Avg episode reward: [(0, '4873.336')]
[2022-07-07 03:59:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5545984. Throughput: 0: 3458.7. Samples: 11097056. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 03:59:56,869][16446] Avg episode reward: [(0, '4827.042')]
[2022-07-07 04:00:01,875][16446] Fps is (10 sec: 1637.6, 60 sec: 1706.5, 300 sec: 1680.0). Total num frames: 5554176. Throughput: 0: 3443.0. Samples: 11107584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:00:01,875][16446] Avg episode reward: [(0, '4833.471')]
[2022-07-07 04:00:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5562368. Throughput: 0: 3390.4. Samples: 11125736. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:00:06,869][16446] Avg episode reward: [(0, '4862.389')]
[2022-07-07 04:00:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5570560. Throughput: 0: 3363.9. Samples: 11146832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:00:11,871][16446] Avg episode reward: [(0, '4835.340')]
[2022-07-07 04:00:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5582848. Throughput: 0: 3377.6. Samples: 11157296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:00:16,869][16446] Avg episode reward: [(0, '4808.574')]
[2022-07-07 04:00:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5591040. Throughput: 0: 3398.6. Samples: 11178808. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:00:21,869][16446] Avg episode reward: [(0, '4943.784')]
[2022-07-07 04:00:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5599232. Throughput: 0: 3390.9. Samples: 11198592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:00:26,869][16446] Avg episode reward: [(0, '4953.914')]
[2022-07-07 04:00:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5607424. Throughput: 0: 3357.2. Samples: 11208608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:00:31,868][16446] Avg episode reward: [(0, '4925.379')]
[2022-07-07 04:00:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5615616. Throughput: 0: 3431.3. Samples: 11229888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:00:36,868][16446] Avg episode reward: [(0, '4854.841')]
[2022-07-07 04:00:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5623808. Throughput: 0: 3375.3. Samples: 11248944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:00:41,869][16446] Avg episode reward: [(0, '4808.448')]
[2022-07-07 04:00:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5632000. Throughput: 0: 3400.2. Samples: 11260568. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:00:46,869][16446] Avg episode reward: [(0, '4808.548')]
[2022-07-07 04:00:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5640192. Throughput: 0: 3446.9. Samples: 11280848. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:00:51,869][16446] Avg episode reward: [(0, '4862.603')]
[2022-07-07 04:00:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5648384. Throughput: 0: 3419.0. Samples: 11300688. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:00:56,869][16446] Avg episode reward: [(0, '4860.058')]
[2022-07-07 04:01:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.9, 300 sec: 1693.9). Total num frames: 5656576. Throughput: 0: 3409.8. Samples: 11310736. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:01:01,868][16446] Avg episode reward: [(0, '4858.157')]
[2022-07-07 04:01:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5664768. Throughput: 0: 3348.3. Samples: 11329480. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:01:06,869][16446] Avg episode reward: [(0, '4855.724')]
[2022-07-07 04:01:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5672960. Throughput: 0: 3343.7. Samples: 11349056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:01:11,868][16446] Avg episode reward: [(0, '4926.846')]
[2022-07-07 04:01:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5681152. Throughput: 0: 3347.4. Samples: 11359240. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:01:16,869][16446] Avg episode reward: [(0, '4929.662')]
[2022-07-07 04:01:21,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 5689344. Throughput: 0: 3309.4. Samples: 11378816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:01:21,870][16446] Avg episode reward: [(0, '4867.742')]
[2022-07-07 04:01:26,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.3, 300 sec: 1693.9). Total num frames: 5697536. Throughput: 0: 3383.2. Samples: 11401200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:01:26,872][16446] Avg episode reward: [(0, '4915.483')]
[2022-07-07 04:01:31,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5705728. Throughput: 0: 3317.7. Samples: 11409864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:01:31,868][16446] Avg episode reward: [(0, '4920.537')]
[2022-07-07 04:01:36,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5713920. Throughput: 0: 3276.8. Samples: 11428304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:01:36,869][16446] Avg episode reward: [(0, '5028.182')]
[2022-07-07 04:01:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5722112. Throughput: 0: 3307.2. Samples: 11449512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:01:41,869][16446] Avg episode reward: [(0, '4991.205')]
[2022-07-07 04:01:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5730304. Throughput: 0: 3326.9. Samples: 11460448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:01:46,869][16446] Avg episode reward: [(0, '4893.159')]
[2022-07-07 04:01:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5742592. Throughput: 0: 3318.8. Samples: 11478824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:01:51,869][16446] Avg episode reward: [(0, '4756.291')]
[2022-07-07 04:01:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5746688. Throughput: 0: 3369.4. Samples: 11500680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:01:56,869][16446] Avg episode reward: [(0, '4724.733')]
[2022-07-07 04:02:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5758976. Throughput: 0: 3374.9. Samples: 11511112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:01,868][16446] Avg episode reward: [(0, '4692.472')]
[2022-07-07 04:02:06,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5767168. Throughput: 0: 3382.7. Samples: 11531032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:02:06,868][16446] Avg episode reward: [(0, '4688.079')]
[2022-07-07 04:02:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5775360. Throughput: 0: 3319.3. Samples: 11550560. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:02:11,869][16446] Avg episode reward: [(0, '4659.132')]
[2022-07-07 04:02:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5783552. Throughput: 0: 3312.2. Samples: 11558912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:02:16,869][16446] Avg episode reward: [(0, '4636.234')]
[2022-07-07 04:02:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5791744. Throughput: 0: 3385.9. Samples: 11580672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:02:21,869][16446] Avg episode reward: [(0, '4724.001')]
[2022-07-07 04:02:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.8, 300 sec: 1680.1). Total num frames: 5799936. Throughput: 0: 3370.8. Samples: 11601200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:26,869][16446] Avg episode reward: [(0, '4645.004')]
[2022-07-07 04:02:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5808128. Throughput: 0: 3404.6. Samples: 11613656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:31,869][16446] Avg episode reward: [(0, '4732.367')]
[2022-07-07 04:02:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5816320. Throughput: 0: 3427.6. Samples: 11633064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:36,869][16446] Avg episode reward: [(0, '4797.744')]
[2022-07-07 04:02:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5824512. Throughput: 0: 3397.0. Samples: 11653544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:41,868][16446] Avg episode reward: [(0, '4848.061')]
[2022-07-07 04:02:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5832704. Throughput: 0: 3416.5. Samples: 11664856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:46,869][16446] Avg episode reward: [(0, '4946.200')]
[2022-07-07 04:02:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5840896. Throughput: 0: 3424.9. Samples: 11685152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:51,869][16446] Avg episode reward: [(0, '4975.180')]
[2022-07-07 04:02:56,872][16446] Fps is (10 sec: 1637.8, 60 sec: 1706.6, 300 sec: 1680.0). Total num frames: 5849088. Throughput: 0: 3441.5. Samples: 11705440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:02:56,872][16446] Avg episode reward: [(0, '5007.984')]
[2022-07-07 04:03:01,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1638.2, 300 sec: 1680.0). Total num frames: 5857280. Throughput: 0: 3456.4. Samples: 11714472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:01,875][16446] Avg episode reward: [(0, '5054.426')]
[2022-07-07 04:03:06,868][16446] Fps is (10 sec: 1639.0, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5865472. Throughput: 0: 3382.4. Samples: 11732880. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:03:06,869][16446] Avg episode reward: [(0, '5113.422')]
[2022-07-07 04:03:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 5873664. Throughput: 0: 3391.8. Samples: 11753832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:03:11,869][16446] Avg episode reward: [(0, '5071.778')]
[2022-07-07 04:03:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5885952. Throughput: 0: 3325.9. Samples: 11763320. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:03:16,869][16446] Avg episode reward: [(0, '5059.328')]
[2022-07-07 04:03:21,869][16446] Fps is (10 sec: 2047.8, 60 sec: 1706.6, 300 sec: 1693.9). Total num frames: 5894144. Throughput: 0: 3365.1. Samples: 11784496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:21,869][16446] Avg episode reward: [(0, '5126.559')]
[2022-07-07 04:03:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5902336. Throughput: 0: 3359.1. Samples: 11804704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:26,869][16446] Avg episode reward: [(0, '5114.544')]
[2022-07-07 04:03:31,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5910528. Throughput: 0: 3337.4. Samples: 11815040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:31,869][16446] Avg episode reward: [(0, '5113.341')]
[2022-07-07 04:03:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 5918720. Throughput: 0: 3358.2. Samples: 11836272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:36,869][16446] Avg episode reward: [(0, '5079.238')]
[2022-07-07 04:03:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5926912. Throughput: 0: 3398.7. Samples: 11858368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:41,869][16446] Avg episode reward: [(0, '5099.238')]
[2022-07-07 04:03:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5935104. Throughput: 0: 3456.2. Samples: 11869976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:46,869][16446] Avg episode reward: [(0, '5133.165')]
[2022-07-07 04:03:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5943296. Throughput: 0: 3518.9. Samples: 11891232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:51,869][16446] Avg episode reward: [(0, '5174.149')]
[2022-07-07 04:03:56,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1775.0, 300 sec: 1707.8). Total num frames: 5955584. Throughput: 0: 3482.1. Samples: 11910528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:03:56,869][16446] Avg episode reward: [(0, '5136.400')]
[2022-07-07 04:04:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1775.1, 300 sec: 1707.8). Total num frames: 5963776. Throughput: 0: 3466.3. Samples: 11919304. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:04:01,868][16446] Avg episode reward: [(0, '5139.389')]
[2022-07-07 04:04:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1707.8). Total num frames: 5971968. Throughput: 0: 3465.0. Samples: 11940416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:04:06,868][16446] Avg episode reward: [(0, '5094.883')]
[2022-07-07 04:04:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1693.9). Total num frames: 5980160. Throughput: 0: 3458.1. Samples: 11960320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:04:11,869][16446] Avg episode reward: [(0, '5195.914')]
[2022-07-07 04:04:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5988352. Throughput: 0: 3453.2. Samples: 11970432. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:04:16,869][16446] Avg episode reward: [(0, '5221.876')]
[2022-07-07 04:04:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 5996544. Throughput: 0: 3469.3. Samples: 11992392. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:04:21,869][16446] Avg episode reward: [(0, '5235.345')]
[2022-07-07 04:04:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6004736. Throughput: 0: 3419.0. Samples: 12012224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:04:26,869][16446] Avg episode reward: [(0, '5183.873')]
[2022-07-07 04:04:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6012928. Throughput: 0: 3400.0. Samples: 12022976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:04:31,868][16446] Avg episode reward: [(0, '5222.812')]
[2022-07-07 04:04:36,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1693.9). Total num frames: 6021120. Throughput: 0: 3349.6. Samples: 12041968. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:04:36,870][16446] Avg episode reward: [(0, '5191.549')]
[2022-07-07 04:04:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6029312. Throughput: 0: 3387.4. Samples: 12062960. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:04:41,869][16446] Avg episode reward: [(0, '5191.847')]
[2022-07-07 04:04:46,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1706.7, 300 sec: 1694.0). Total num frames: 6037504. Throughput: 0: 3443.6. Samples: 12074264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:04:46,868][16446] Avg episode reward: [(0, '5115.045')]
[2022-07-07 04:04:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6045696. Throughput: 0: 3378.1. Samples: 12092432. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:04:51,869][16446] Avg episode reward: [(0, '5080.131')]
[2022-07-07 04:04:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1694.0). Total num frames: 6053888. Throughput: 0: 3423.3. Samples: 12114368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:04:56,869][16446] Avg episode reward: [(0, '5086.609')]
[2022-07-07 04:05:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 6062080. Throughput: 0: 3407.1. Samples: 12123752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:05:01,869][16446] Avg episode reward: [(0, '5004.415')]
[2022-07-07 04:05:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 6070272. Throughput: 0: 3294.8. Samples: 12140656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:05:06,869][16446] Avg episode reward: [(0, '5002.956')]
[2022-07-07 04:05:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6078464. Throughput: 0: 3301.5. Samples: 12160792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:05:11,869][16446] Avg episode reward: [(0, '5010.721')]
[2022-07-07 04:05:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6086656. Throughput: 0: 3286.4. Samples: 12170864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:05:16,869][16446] Avg episode reward: [(0, '4983.319')]
[2022-07-07 04:05:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6094848. Throughput: 0: 3282.0. Samples: 12189656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:05:21,869][16446] Avg episode reward: [(0, '4910.274')]
[2022-07-07 04:05:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6103040. Throughput: 0: 3334.9. Samples: 12213032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:05:26,869][16446] Avg episode reward: [(0, '4896.577')]
[2022-07-07 04:05:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6115328. Throughput: 0: 3289.8. Samples: 12222304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:05:31,869][16446] Avg episode reward: [(0, '4842.112')]
[2022-07-07 04:05:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6123520. Throughput: 0: 3352.9. Samples: 12243312. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:05:36,869][16446] Avg episode reward: [(0, '4884.107')]
[2022-07-07 04:05:41,872][16446] Fps is (10 sec: 1637.7, 60 sec: 1706.6, 300 sec: 1693.9). Total num frames: 6131712. Throughput: 0: 3298.6. Samples: 12262816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:05:41,873][16446] Avg episode reward: [(0, '4912.592')]
[2022-07-07 04:05:46,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1706.6, 300 sec: 1693.9). Total num frames: 6139904. Throughput: 0: 3285.7. Samples: 12271616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:05:46,870][16446] Avg episode reward: [(0, '4917.655')]
[2022-07-07 04:05:51,868][16446] Fps is (10 sec: 1639.1, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6148096. Throughput: 0: 3368.5. Samples: 12292240. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:05:51,869][16446] Avg episode reward: [(0, '4839.513')]
[2022-07-07 04:05:56,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6156288. Throughput: 0: 3371.4. Samples: 12312504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:05:56,869][16446] Avg episode reward: [(0, '4825.195')]
[2022-07-07 04:06:01,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1706.5, 300 sec: 1693.9). Total num frames: 6164480. Throughput: 0: 3373.9. Samples: 12322712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:01,875][16446] Avg episode reward: [(0, '4962.908')]
[2022-07-07 04:06:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6172672. Throughput: 0: 3409.1. Samples: 12343064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:06,869][16446] Avg episode reward: [(0, '4966.471')]
[2022-07-07 04:06:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6180864. Throughput: 0: 3328.5. Samples: 12362816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:11,869][16446] Avg episode reward: [(0, '5001.137')]
[2022-07-07 04:06:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6189056. Throughput: 0: 3348.3. Samples: 12372976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:16,869][16446] Avg episode reward: [(0, '5022.742')]
[2022-07-07 04:06:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1694.0). Total num frames: 6197248. Throughput: 0: 3355.0. Samples: 12394288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:21,869][16446] Avg episode reward: [(0, '5060.305')]
[2022-07-07 04:06:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6205440. Throughput: 0: 3369.7. Samples: 12414440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:26,870][16446] Avg episode reward: [(0, '5109.505')]
[2022-07-07 04:06:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 6213632. Throughput: 0: 3398.9. Samples: 12424560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:31,868][16446] Avg episode reward: [(0, '5142.865')]
[2022-07-07 04:06:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 6221824. Throughput: 0: 3392.0. Samples: 12444880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:06:36,869][16446] Avg episode reward: [(0, '5139.133')]
[2022-07-07 04:06:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.8, 300 sec: 1707.8). Total num frames: 6234112. Throughput: 0: 3401.4. Samples: 12465568. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:06:41,869][16446] Avg episode reward: [(0, '5152.158')]
[2022-07-07 04:06:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1680.1). Total num frames: 6238208. Throughput: 0: 3403.5. Samples: 12475848. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:06:46,869][16446] Avg episode reward: [(0, '5257.391')]
[2022-07-07 04:06:51,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 6246400. Throughput: 0: 3381.3. Samples: 12495224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:06:51,868][16446] Avg episode reward: [(0, '5263.397')]
[2022-07-07 04:06:56,868][16446] Fps is (10 sec: 2047.9, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6258688. Throughput: 0: 3416.7. Samples: 12516568. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:06:56,869][16446] Avg episode reward: [(0, '5241.058')]
[2022-07-07 04:07:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.5, 300 sec: 1680.0). Total num frames: 6262784. Throughput: 0: 3393.0. Samples: 12525672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:07:01,871][16446] Avg episode reward: [(0, '5244.003')]
[2022-07-07 04:07:06,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6275072. Throughput: 0: 3330.5. Samples: 12544160. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:07:06,868][16446] Avg episode reward: [(0, '5220.809')]
[2022-07-07 04:07:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6279168. Throughput: 0: 3353.2. Samples: 12565336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:07:11,869][16446] Avg episode reward: [(0, '5250.289')]
[2022-07-07 04:07:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6291456. Throughput: 0: 3336.9. Samples: 12574720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:07:16,869][16446] Avg episode reward: [(0, '5254.928')]
[2022-07-07 04:07:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6299648. Throughput: 0: 3336.0. Samples: 12595000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:07:21,869][16446] Avg episode reward: [(0, '5258.332')]
[2022-07-07 04:07:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6307840. Throughput: 0: 3328.7. Samples: 12615360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:07:26,869][16446] Avg episode reward: [(0, '5210.344')]
[2022-07-07 04:07:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6316032. Throughput: 0: 3295.6. Samples: 12624152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:07:31,868][16446] Avg episode reward: [(0, '5130.837')]
[2022-07-07 04:07:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6324224. Throughput: 0: 3361.6. Samples: 12646496. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:07:36,869][16446] Avg episode reward: [(0, '5133.364')]
[2022-07-07 04:07:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 6332416. Throughput: 0: 3298.0. Samples: 12664976. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:07:41,869][16446] Avg episode reward: [(0, '5112.968')]
[2022-07-07 04:07:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6340608. Throughput: 0: 3307.1. Samples: 12674480. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:07:46,870][16446] Avg episode reward: [(0, '5090.757')]
[2022-07-07 04:07:51,877][16446] Fps is (10 sec: 1636.9, 60 sec: 1706.4, 300 sec: 1693.9). Total num frames: 6348800. Throughput: 0: 3387.9. Samples: 12696648. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:07:51,878][16446] Avg episode reward: [(0, '5082.601')]
[2022-07-07 04:07:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1694.0). Total num frames: 6356992. Throughput: 0: 3363.6. Samples: 12716696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:07:56,868][16446] Avg episode reward: [(0, '5112.149')]
[2022-07-07 04:08:01,869][16446] Fps is (10 sec: 1639.7, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6365184. Throughput: 0: 3415.6. Samples: 12728424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:01,870][16446] Avg episode reward: [(0, '5075.261')]
[2022-07-07 04:08:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1693.9). Total num frames: 6373376. Throughput: 0: 3369.6. Samples: 12746632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:06,869][16446] Avg episode reward: [(0, '5096.823')]
[2022-07-07 04:08:11,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6381568. Throughput: 0: 3391.5. Samples: 12767976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:11,869][16446] Avg episode reward: [(0, '5111.781')]
[2022-07-07 04:08:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6389760. Throughput: 0: 3411.0. Samples: 12777648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:16,869][16446] Avg episode reward: [(0, '5114.038')]
[2022-07-07 04:08:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6397952. Throughput: 0: 3350.8. Samples: 12797280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:21,869][16446] Avg episode reward: [(0, '5186.666')]
[2022-07-07 04:08:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6410240. Throughput: 0: 3421.5. Samples: 12818944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:26,869][16446] Avg episode reward: [(0, '5241.924')]
[2022-07-07 04:08:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6418432. Throughput: 0: 3424.7. Samples: 12828592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:31,868][16446] Avg episode reward: [(0, '5201.014')]
[2022-07-07 04:08:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6426624. Throughput: 0: 3430.2. Samples: 12850976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:08:36,868][16446] Avg episode reward: [(0, '5221.176')]
[2022-07-07 04:08:41,870][16446] Fps is (10 sec: 1638.0, 60 sec: 1706.6, 300 sec: 1693.9). Total num frames: 6434816. Throughput: 0: 3413.2. Samples: 12870296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:08:41,871][16446] Avg episode reward: [(0, '5222.601')]
[2022-07-07 04:08:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6443008. Throughput: 0: 3378.0. Samples: 12880432. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:08:46,869][16446] Avg episode reward: [(0, '5275.395')]
[2022-07-07 04:08:51,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1706.9, 300 sec: 1680.1). Total num frames: 6451200. Throughput: 0: 3459.7. Samples: 12902320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:08:51,869][16446] Avg episode reward: [(0, '5229.879')]
[2022-07-07 04:08:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6459392. Throughput: 0: 3454.0. Samples: 12923408. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:08:56,869][16446] Avg episode reward: [(0, '5216.097')]
[2022-07-07 04:09:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6467584. Throughput: 0: 3451.0. Samples: 12932944. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:09:01,868][16446] Avg episode reward: [(0, '5220.193')]
[2022-07-07 04:09:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6475776. Throughput: 0: 3428.3. Samples: 12951552. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:09:06,869][16446] Avg episode reward: [(0, '5222.688')]
[2022-07-07 04:09:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6483968. Throughput: 0: 3382.0. Samples: 12971136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:09:11,869][16446] Avg episode reward: [(0, '5257.745')]
[2022-07-07 04:09:16,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1706.6, 300 sec: 1680.0). Total num frames: 6492160. Throughput: 0: 3397.8. Samples: 12981504. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:09:16,871][16446] Avg episode reward: [(0, '5272.792')]
[2022-07-07 04:09:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6500352. Throughput: 0: 3338.8. Samples: 13001224. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:09:21,869][16446] Avg episode reward: [(0, '5170.961')]
[2022-07-07 04:09:26,869][16446] Fps is (10 sec: 1638.8, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6508544. Throughput: 0: 3344.3. Samples: 13020784. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:09:26,872][16446] Avg episode reward: [(0, '5109.149')]
[2022-07-07 04:09:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6516736. Throughput: 0: 3338.5. Samples: 13030664. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:09:31,869][16446] Avg episode reward: [(0, '5114.276')]
[2022-07-07 04:09:36,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6524928. Throughput: 0: 3272.7. Samples: 13049592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:09:36,869][16446] Avg episode reward: [(0, '5164.051')]
[2022-07-07 04:09:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1680.1). Total num frames: 6533120. Throughput: 0: 3235.4. Samples: 13069000. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:09:41,869][16446] Avg episode reward: [(0, '5163.842')]
[2022-07-07 04:09:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6541312. Throughput: 0: 3269.9. Samples: 13080088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:09:46,869][16446] Avg episode reward: [(0, '5132.804')]
[2022-07-07 04:09:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6549504. Throughput: 0: 3294.8. Samples: 13099816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:09:51,869][16446] Avg episode reward: [(0, '5206.448')]
[2022-07-07 04:09:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6557696. Throughput: 0: 3344.2. Samples: 13121624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:09:56,869][16446] Avg episode reward: [(0, '5192.900')]
[2022-07-07 04:10:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6569984. Throughput: 0: 3333.9. Samples: 13131520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:01,869][16446] Avg episode reward: [(0, '5100.741')]
[2022-07-07 04:10:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6574080. Throughput: 0: 3347.6. Samples: 13151864. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:10:06,869][16446] Avg episode reward: [(0, '5107.483')]
[2022-07-07 04:10:11,870][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1693.9). Total num frames: 6586368. Throughput: 0: 3367.4. Samples: 13172320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:10:11,870][16446] Avg episode reward: [(0, '5096.483')]
[2022-07-07 04:10:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1680.1). Total num frames: 6590464. Throughput: 0: 3334.2. Samples: 13180704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:10:16,868][16446] Avg episode reward: [(0, '5187.137')]
[2022-07-07 04:10:21,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6602752. Throughput: 0: 3380.8. Samples: 13201728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:10:21,868][16446] Avg episode reward: [(0, '5255.331')]
[2022-07-07 04:10:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6610944. Throughput: 0: 3394.5. Samples: 13221752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:26,869][16446] Avg episode reward: [(0, '5298.484')]
[2022-07-07 04:10:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6619136. Throughput: 0: 3333.2. Samples: 13230080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:31,869][16446] Avg episode reward: [(0, '5334.572')]
[2022-07-07 04:10:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6627328. Throughput: 0: 3346.8. Samples: 13250424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:36,869][16446] Avg episode reward: [(0, '5346.076')]
[2022-07-07 04:10:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6635520. Throughput: 0: 3300.3. Samples: 13270136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:41,869][16446] Avg episode reward: [(0, '5375.737')]
[2022-07-07 04:10:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6643712. Throughput: 0: 3282.3. Samples: 13279224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:46,869][16446] Avg episode reward: [(0, '5395.290')]
[2022-07-07 04:10:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6651904. Throughput: 0: 3325.9. Samples: 13301528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:51,868][16446] Avg episode reward: [(0, '5411.033')]
[2022-07-07 04:10:56,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1680.1). Total num frames: 6660096. Throughput: 0: 3295.7. Samples: 13320624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:10:56,870][16446] Avg episode reward: [(0, '5426.016')]
[2022-07-07 04:11:01,875][16446] Fps is (10 sec: 1637.3, 60 sec: 1638.2, 300 sec: 1680.0). Total num frames: 6668288. Throughput: 0: 3351.1. Samples: 13331528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:11:01,875][16446] Avg episode reward: [(0, '5417.360')]
[2022-07-07 04:11:06,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6676480. Throughput: 0: 3328.0. Samples: 13351488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:11:06,868][16446] Avg episode reward: [(0, '5455.564')]
[2022-07-07 04:11:11,868][16446] Fps is (10 sec: 1639.5, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6684672. Throughput: 0: 3363.6. Samples: 13373112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:11:11,869][16446] Avg episode reward: [(0, '5453.563')]
[2022-07-07 04:11:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6692864. Throughput: 0: 3433.8. Samples: 13384600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:11:16,869][16446] Avg episode reward: [(0, '5407.893')]
[2022-07-07 04:11:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6701056. Throughput: 0: 3387.9. Samples: 13402880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:11:21,869][16446] Avg episode reward: [(0, '5379.764')]
[2022-07-07 04:11:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 6709248. Throughput: 0: 3403.2. Samples: 13423280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:11:26,869][16446] Avg episode reward: [(0, '5225.549')]
[2022-07-07 04:11:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6721536. Throughput: 0: 3458.1. Samples: 13434840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:11:31,869][16446] Avg episode reward: [(0, '5228.397')]
[2022-07-07 04:11:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6729728. Throughput: 0: 3447.6. Samples: 13456672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:11:36,869][16446] Avg episode reward: [(0, '5238.178')]
[2022-07-07 04:11:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6737920. Throughput: 0: 3473.7. Samples: 13476936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:11:41,869][16446] Avg episode reward: [(0, '5221.928')]
[2022-07-07 04:11:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6746112. Throughput: 0: 3499.7. Samples: 13488992. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:11:46,869][16446] Avg episode reward: [(0, '5169.688')]
[2022-07-07 04:11:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6754304. Throughput: 0: 3483.0. Samples: 13508224. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:11:51,868][16446] Avg episode reward: [(0, '5110.676')]
[2022-07-07 04:11:56,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6762496. Throughput: 0: 3492.9. Samples: 13530296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:11:56,870][16446] Avg episode reward: [(0, '5169.874')]
[2022-07-07 04:12:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.9, 300 sec: 1680.1). Total num frames: 6770688. Throughput: 0: 3468.4. Samples: 13540680. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:12:01,869][16446] Avg episode reward: [(0, '5134.680')]
[2022-07-07 04:12:06,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6778880. Throughput: 0: 3443.6. Samples: 13557840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:12:06,869][16446] Avg episode reward: [(0, '5144.212')]
[2022-07-07 04:12:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6787072. Throughput: 0: 3439.1. Samples: 13578040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:12:11,869][16446] Avg episode reward: [(0, '5040.737')]
[2022-07-07 04:12:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 6795264. Throughput: 0: 3444.3. Samples: 13589832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:12:16,869][16446] Avg episode reward: [(0, '5079.637')]
[2022-07-07 04:12:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1693.9). Total num frames: 6807552. Throughput: 0: 3420.8. Samples: 13610608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:12:21,869][16446] Avg episode reward: [(0, '5153.504')]
[2022-07-07 04:12:26,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1693.9). Total num frames: 6815744. Throughput: 0: 3446.6. Samples: 13632032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:12:26,869][16446] Avg episode reward: [(0, '5044.891')]
[2022-07-07 04:12:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6823936. Throughput: 0: 3429.9. Samples: 13643336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:12:31,872][16446] Avg episode reward: [(0, '4950.878')]
[2022-07-07 04:12:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6832128. Throughput: 0: 3468.1. Samples: 13664288. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:12:36,869][16446] Avg episode reward: [(0, '4897.993')]
[2022-07-07 04:12:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6840320. Throughput: 0: 3489.9. Samples: 13687336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:12:41,869][16446] Avg episode reward: [(0, '4919.674')]
[2022-07-07 04:12:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1707.9). Total num frames: 6852608. Throughput: 0: 3479.8. Samples: 13697272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:12:46,868][16446] Avg episode reward: [(0, '4744.462')]
[2022-07-07 04:12:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1707.8). Total num frames: 6860800. Throughput: 0: 3566.8. Samples: 13718344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:12:51,869][16446] Avg episode reward: [(0, '4737.707')]
[2022-07-07 04:12:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1775.0, 300 sec: 1707.8). Total num frames: 6868992. Throughput: 0: 3553.8. Samples: 13737960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:12:56,869][16446] Avg episode reward: [(0, '4689.307')]
[2022-07-07 04:13:01,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1774.9, 300 sec: 1707.8). Total num frames: 6877184. Throughput: 0: 3477.1. Samples: 13746304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:13:01,869][16446] Avg episode reward: [(0, '4746.652')]
[2022-07-07 04:13:06,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1774.9, 300 sec: 1707.8). Total num frames: 6885376. Throughput: 0: 3499.1. Samples: 13768072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:13:06,869][16446] Avg episode reward: [(0, '4766.829')]
[2022-07-07 04:13:11,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1774.9, 300 sec: 1707.8). Total num frames: 6893568. Throughput: 0: 3480.2. Samples: 13788640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:13:11,869][16446] Avg episode reward: [(0, '4854.026')]
[2022-07-07 04:13:16,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1774.9, 300 sec: 1707.8). Total num frames: 6901760. Throughput: 0: 3461.3. Samples: 13799096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:13:16,869][16446] Avg episode reward: [(0, '4960.591')]
[2022-07-07 04:13:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6909952. Throughput: 0: 3451.4. Samples: 13819600. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:13:21,869][16446] Avg episode reward: [(0, '4932.656')]
[2022-07-07 04:13:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6918144. Throughput: 0: 3349.9. Samples: 13838080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:13:26,869][16446] Avg episode reward: [(0, '5011.900')]
[2022-07-07 04:13:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 6926336. Throughput: 0: 3384.5. Samples: 13849576. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:13:31,868][16446] Avg episode reward: [(0, '5022.846')]
[2022-07-07 04:13:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1694.0). Total num frames: 6934528. Throughput: 0: 3396.8. Samples: 13871200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:13:36,869][16446] Avg episode reward: [(0, '5084.154')]
[2022-07-07 04:13:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1707.8). Total num frames: 6946816. Throughput: 0: 3452.1. Samples: 13893304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:13:41,869][16446] Avg episode reward: [(0, '5155.945')]
[2022-07-07 04:13:46,870][16446] Fps is (10 sec: 2047.6, 60 sec: 1706.6, 300 sec: 1707.8). Total num frames: 6955008. Throughput: 0: 3455.7. Samples: 13901816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:13:46,870][16446] Avg episode reward: [(0, '5239.864')]
[2022-07-07 04:13:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 6963200. Throughput: 0: 3485.8. Samples: 13924928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:13:51,868][16446] Avg episode reward: [(0, '5286.805')]
[2022-07-07 04:13:56,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 6971392. Throughput: 0: 3477.7. Samples: 13945136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:13:56,869][16446] Avg episode reward: [(0, '5331.276')]
[2022-07-07 04:14:01,879][16446] Fps is (10 sec: 1636.6, 60 sec: 1706.4, 300 sec: 1707.8). Total num frames: 6979584. Throughput: 0: 3504.8. Samples: 13956848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:14:01,879][16446] Avg episode reward: [(0, '5287.199')]
[2022-07-07 04:14:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 6987776. Throughput: 0: 3461.7. Samples: 13975376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:14:06,869][16446] Avg episode reward: [(0, '5254.487')]
[2022-07-07 04:14:11,868][16446] Fps is (10 sec: 1640.2, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 6995968. Throughput: 0: 3523.0. Samples: 13996616. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:14:11,868][16446] Avg episode reward: [(0, '5275.118')]
[2022-07-07 04:14:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 7008256. Throughput: 0: 3512.5. Samples: 14007640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:16,869][16446] Avg episode reward: [(0, '5193.908')]
[2022-07-07 04:14:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 7016448. Throughput: 0: 3499.7. Samples: 14028688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:21,869][16446] Avg episode reward: [(0, '5225.457')]
[2022-07-07 04:14:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 7024640. Throughput: 0: 3461.5. Samples: 14049072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:26,869][16446] Avg episode reward: [(0, '5249.388')]
[2022-07-07 04:14:31,871][16446] Fps is (10 sec: 1637.8, 60 sec: 1774.8, 300 sec: 1721.7). Total num frames: 7032832. Throughput: 0: 3478.8. Samples: 14058368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:31,872][16446] Avg episode reward: [(0, '5237.349')]
[2022-07-07 04:14:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 7041024. Throughput: 0: 3461.7. Samples: 14080704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:36,868][16446] Avg episode reward: [(0, '5216.320')]
[2022-07-07 04:14:41,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 7049216. Throughput: 0: 3429.9. Samples: 14099480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:41,869][16446] Avg episode reward: [(0, '5262.282')]
[2022-07-07 04:14:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 7057408. Throughput: 0: 3405.4. Samples: 14110056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:46,869][16446] Avg episode reward: [(0, '5252.093')]
[2022-07-07 04:14:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 7065600. Throughput: 0: 3494.2. Samples: 14132616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:51,869][16446] Avg episode reward: [(0, '5276.591')]
[2022-07-07 04:14:56,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1721.7). Total num frames: 7077888. Throughput: 0: 3696.7. Samples: 14162968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:14:56,868][16446] Avg episode reward: [(0, '5316.069')]
[2022-07-07 04:15:01,868][16446] Fps is (10 sec: 2457.6, 60 sec: 1843.5, 300 sec: 1749.5). Total num frames: 7090176. Throughput: 0: 3700.1. Samples: 14174144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:01,869][16446] Avg episode reward: [(0, '5350.350')]
[2022-07-07 04:15:06,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1843.2, 300 sec: 1735.6). Total num frames: 7098368. Throughput: 0: 3734.4. Samples: 14196736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:06,869][16446] Avg episode reward: [(0, '5414.529')]
[2022-07-07 04:15:11,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1843.2, 300 sec: 1749.5). Total num frames: 7106560. Throughput: 0: 3643.5. Samples: 14213032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:11,870][16446] Avg episode reward: [(0, '5418.232')]
[2022-07-07 04:15:16,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1774.8, 300 sec: 1735.6). Total num frames: 7114752. Throughput: 0: 3708.7. Samples: 14225256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:16,871][16446] Avg episode reward: [(0, '5329.304')]
[2022-07-07 04:15:21,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1774.9, 300 sec: 1735.6). Total num frames: 7122944. Throughput: 0: 3691.2. Samples: 14246808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:21,869][16446] Avg episode reward: [(0, '5329.413')]
[2022-07-07 04:15:26,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1774.9, 300 sec: 1735.6). Total num frames: 7131136. Throughput: 0: 3719.6. Samples: 14266864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:26,868][16446] Avg episode reward: [(0, '5367.537')]
[2022-07-07 04:15:31,870][16446] Fps is (10 sec: 2047.7, 60 sec: 1843.3, 300 sec: 1749.5). Total num frames: 7143424. Throughput: 0: 3762.9. Samples: 14279392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:31,870][16446] Avg episode reward: [(0, '5360.597')]
[2022-07-07 04:15:36,868][16446] Fps is (10 sec: 2457.6, 60 sec: 1911.5, 300 sec: 1763.4). Total num frames: 7155712. Throughput: 0: 3865.1. Samples: 14306544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:36,869][16446] Avg episode reward: [(0, '5369.904')]
[2022-07-07 04:15:41,868][16446] Fps is (10 sec: 2048.3, 60 sec: 1911.5, 300 sec: 1763.4). Total num frames: 7163904. Throughput: 0: 3663.1. Samples: 14327808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:15:41,869][16446] Avg episode reward: [(0, '5346.955')]
[2022-07-07 04:15:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1911.5, 300 sec: 1763.4). Total num frames: 7172096. Throughput: 0: 3625.8. Samples: 14337304. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:15:46,869][16446] Avg episode reward: [(0, '5363.542')]
[2022-07-07 04:15:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1911.5, 300 sec: 1763.4). Total num frames: 7180288. Throughput: 0: 3609.8. Samples: 14359176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:15:51,869][16446] Avg episode reward: [(0, '5370.962')]
[2022-07-07 04:15:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1763.4). Total num frames: 7188480. Throughput: 0: 3680.6. Samples: 14378656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:15:56,869][16446] Avg episode reward: [(0, '5352.660')]
[2022-07-07 04:16:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1774.8, 300 sec: 1763.3). Total num frames: 7196672. Throughput: 0: 3658.8. Samples: 14389904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:16:01,871][16446] Avg episode reward: [(0, '5262.778')]
[2022-07-07 04:16:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1763.4). Total num frames: 7204864. Throughput: 0: 3595.0. Samples: 14408584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:16:06,868][16446] Avg episode reward: [(0, '5285.791')]
[2022-07-07 04:16:11,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1775.0, 300 sec: 1763.4). Total num frames: 7213056. Throughput: 0: 3570.0. Samples: 14427512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:16:11,869][16446] Avg episode reward: [(0, '5393.157')]
[2022-07-07 04:16:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1775.0, 300 sec: 1763.4). Total num frames: 7221248. Throughput: 0: 3528.5. Samples: 14438168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:16:16,869][16446] Avg episode reward: [(0, '5409.163')]
[2022-07-07 04:16:21,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1774.9, 300 sec: 1763.4). Total num frames: 7229440. Throughput: 0: 3383.0. Samples: 14458784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:16:21,870][16446] Avg episode reward: [(0, '5372.058')]
[2022-07-07 04:16:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1749.5). Total num frames: 7237632. Throughput: 0: 3348.1. Samples: 14478472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:16:26,869][16446] Avg episode reward: [(0, '5366.209')]
[2022-07-07 04:16:31,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1706.7, 300 sec: 1749.5). Total num frames: 7245824. Throughput: 0: 3364.3. Samples: 14488696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:16:31,869][16446] Avg episode reward: [(0, '5326.871')]
[2022-07-07 04:16:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1749.5). Total num frames: 7254016. Throughput: 0: 3339.7. Samples: 14509464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:16:36,869][16446] Avg episode reward: [(0, '5339.625')]
[2022-07-07 04:16:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1749.5). Total num frames: 7262208. Throughput: 0: 3371.9. Samples: 14530392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:16:41,869][16446] Avg episode reward: [(0, '5334.517')]
[2022-07-07 04:16:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1749.5). Total num frames: 7270400. Throughput: 0: 3349.2. Samples: 14540608. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:16:46,869][16446] Avg episode reward: [(0, '5276.251')]
[2022-07-07 04:16:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1749.5). Total num frames: 7278592. Throughput: 0: 3345.1. Samples: 14559112. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:16:51,869][16446] Avg episode reward: [(0, '5206.287')]
[2022-07-07 04:16:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1749.5). Total num frames: 7286784. Throughput: 0: 3401.2. Samples: 14580568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:16:56,869][16446] Avg episode reward: [(0, '5227.721')]
[2022-07-07 04:17:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1749.5). Total num frames: 7294976. Throughput: 0: 3373.0. Samples: 14589952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:01,869][16446] Avg episode reward: [(0, '5274.883')]
[2022-07-07 04:17:06,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1763.4). Total num frames: 7307264. Throughput: 0: 3317.4. Samples: 14608064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:06,868][16446] Avg episode reward: [(0, '5194.784')]
[2022-07-07 04:17:11,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1763.4). Total num frames: 7315456. Throughput: 0: 3377.4. Samples: 14630456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:11,869][16446] Avg episode reward: [(0, '5163.829')]
[2022-07-07 04:17:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1749.5). Total num frames: 7323648. Throughput: 0: 3349.0. Samples: 14639400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:16,869][16446] Avg episode reward: [(0, '5157.675')]
[2022-07-07 04:17:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1749.5). Total num frames: 7331840. Throughput: 0: 3394.7. Samples: 14662224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:21,868][16446] Avg episode reward: [(0, '5162.135')]
[2022-07-07 04:17:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1749.5). Total num frames: 7340032. Throughput: 0: 3326.0. Samples: 14680064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:26,869][16446] Avg episode reward: [(0, '5155.258')]
[2022-07-07 04:17:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1749.5). Total num frames: 7348224. Throughput: 0: 3320.2. Samples: 14690016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:31,869][16446] Avg episode reward: [(0, '5102.613')]
[2022-07-07 04:17:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1749.5). Total num frames: 7356416. Throughput: 0: 3407.7. Samples: 14712456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:17:36,868][16446] Avg episode reward: [(0, '5065.700')]
[2022-07-07 04:17:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 7364608. Throughput: 0: 3362.7. Samples: 14731888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:17:41,869][16446] Avg episode reward: [(0, '5095.027')]
[2022-07-07 04:17:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 7372800. Throughput: 0: 3416.5. Samples: 14743696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:17:46,869][16446] Avg episode reward: [(0, '5083.001')]
[2022-07-07 04:17:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 7380992. Throughput: 0: 3421.5. Samples: 14762032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:17:51,868][16446] Avg episode reward: [(0, '5078.418')]
[2022-07-07 04:17:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 7389184. Throughput: 0: 3383.1. Samples: 14782696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:17:56,869][16446] Avg episode reward: [(0, '5046.773')]
[2022-07-07 04:18:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 7397376. Throughput: 0: 3403.9. Samples: 14792576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:01,870][16446] Avg episode reward: [(0, '5124.193')]
[2022-07-07 04:18:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 7405568. Throughput: 0: 3302.6. Samples: 14810840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:06,869][16446] Avg episode reward: [(0, '5114.558')]
[2022-07-07 04:18:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 7413760. Throughput: 0: 3310.8. Samples: 14829048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:11,869][16446] Avg episode reward: [(0, '5176.820')]
[2022-07-07 04:18:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 7421952. Throughput: 0: 3343.8. Samples: 14840488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:16,869][16446] Avg episode reward: [(0, '5027.625')]
[2022-07-07 04:18:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 7430144. Throughput: 0: 3278.2. Samples: 14859976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:21,868][16446] Avg episode reward: [(0, '5037.996')]
[2022-07-07 04:18:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 7438336. Throughput: 0: 3284.6. Samples: 14879696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:26,869][16446] Avg episode reward: [(0, '4977.785')]
[2022-07-07 04:18:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 7446528. Throughput: 0: 3276.4. Samples: 14891136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:31,869][16446] Avg episode reward: [(0, '4939.431')]
[2022-07-07 04:18:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 7454720. Throughput: 0: 3274.8. Samples: 14909400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:36,869][16446] Avg episode reward: [(0, '4940.793')]
[2022-07-07 04:18:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 7462912. Throughput: 0: 3233.4. Samples: 14928200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:41,869][16446] Avg episode reward: [(0, '4973.914')]
[2022-07-07 04:18:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 7471104. Throughput: 0: 3277.3. Samples: 14940056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:46,869][16446] Avg episode reward: [(0, '4848.231')]
[2022-07-07 04:18:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 7479296. Throughput: 0: 3292.1. Samples: 14958984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:51,869][16446] Avg episode reward: [(0, '4878.529')]
[2022-07-07 04:18:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.8). Total num frames: 7487488. Throughput: 0: 3315.4. Samples: 14978240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:18:56,869][16446] Avg episode reward: [(0, '4829.413')]
[2022-07-07 04:19:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 7495680. Throughput: 0: 3306.7. Samples: 14989288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:01,869][16446] Avg episode reward: [(0, '4795.821')]
[2022-07-07 04:19:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 7503872. Throughput: 0: 3281.6. Samples: 15007648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:06,869][16446] Avg episode reward: [(0, '4825.613')]
[2022-07-07 04:19:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 7512064. Throughput: 0: 3256.9. Samples: 15026256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:11,869][16446] Avg episode reward: [(0, '4794.283')]
[2022-07-07 04:19:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 7520256. Throughput: 0: 3226.3. Samples: 15036320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:16,869][16446] Avg episode reward: [(0, '4695.759')]
[2022-07-07 04:19:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 7528448. Throughput: 0: 3277.7. Samples: 15056896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:21,868][16446] Avg episode reward: [(0, '4769.062')]
[2022-07-07 04:19:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 7536640. Throughput: 0: 3347.5. Samples: 15078840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:26,869][16446] Avg episode reward: [(0, '4787.598')]
[2022-07-07 04:19:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 7544832. Throughput: 0: 3303.6. Samples: 15088720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:31,869][16446] Avg episode reward: [(0, '4755.370')]
[2022-07-07 04:19:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 7557120. Throughput: 0: 3333.7. Samples: 15109000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:36,868][16446] Avg episode reward: [(0, '4852.620')]
[2022-07-07 04:19:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 7565312. Throughput: 0: 3385.1. Samples: 15130568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:41,869][16446] Avg episode reward: [(0, '4895.536')]
[2022-07-07 04:19:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 7573504. Throughput: 0: 3364.1. Samples: 15140672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:46,869][16446] Avg episode reward: [(0, '5005.044')]
[2022-07-07 04:19:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 7581696. Throughput: 0: 3432.5. Samples: 15162112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:19:51,868][16446] Avg episode reward: [(0, '5004.545')]
[2022-07-07 04:19:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 7589888. Throughput: 0: 3442.7. Samples: 15181176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:19:56,869][16446] Avg episode reward: [(0, '4954.531')]
[2022-07-07 04:20:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 7598080. Throughput: 0: 3471.5. Samples: 15192536. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:20:01,868][16446] Avg episode reward: [(0, '4987.155')]
[2022-07-07 04:20:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 7606272. Throughput: 0: 3441.1. Samples: 15211744. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:20:06,869][16446] Avg episode reward: [(0, '5076.556')]
[2022-07-07 04:20:11,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1706.6, 300 sec: 1694.0). Total num frames: 7614464. Throughput: 0: 3340.8. Samples: 15229176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:20:11,869][16446] Avg episode reward: [(0, '5261.928')]
[2022-07-07 04:20:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 7622656. Throughput: 0: 3374.9. Samples: 15240592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:20:16,869][16446] Avg episode reward: [(0, '5250.938')]
[2022-07-07 04:20:21,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 7630848. Throughput: 0: 3392.5. Samples: 15261664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:21,869][16446] Avg episode reward: [(0, '5280.878')]
[2022-07-07 04:20:26,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1680.1). Total num frames: 7639040. Throughput: 0: 3396.5. Samples: 15283416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:26,870][16446] Avg episode reward: [(0, '5255.807')]
[2022-07-07 04:20:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 7647232. Throughput: 0: 3370.7. Samples: 15292352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:31,869][16446] Avg episode reward: [(0, '5185.493')]
[2022-07-07 04:20:36,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7655424. Throughput: 0: 3305.3. Samples: 15310848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:36,868][16446] Avg episode reward: [(0, '5199.591')]
[2022-07-07 04:20:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7663616. Throughput: 0: 3403.0. Samples: 15334312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:41,869][16446] Avg episode reward: [(0, '5231.698')]
[2022-07-07 04:20:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7671808. Throughput: 0: 3350.0. Samples: 15343288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:46,869][16446] Avg episode reward: [(0, '5222.904')]
[2022-07-07 04:20:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7684096. Throughput: 0: 3343.1. Samples: 15362184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:51,869][16446] Avg episode reward: [(0, '5179.053')]
[2022-07-07 04:20:56,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7692288. Throughput: 0: 3450.5. Samples: 15384448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:20:56,869][16446] Avg episode reward: [(0, '5213.714')]
[2022-07-07 04:21:01,870][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1680.0). Total num frames: 7700480. Throughput: 0: 3418.2. Samples: 15394416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:21:01,870][16446] Avg episode reward: [(0, '5237.598')]
[2022-07-07 04:21:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7708672. Throughput: 0: 3375.8. Samples: 15413576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:21:06,869][16446] Avg episode reward: [(0, '5187.630')]
[2022-07-07 04:21:11,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7716864. Throughput: 0: 3333.6. Samples: 15433424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:21:11,869][16446] Avg episode reward: [(0, '5069.553')]
[2022-07-07 04:21:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7725056. Throughput: 0: 3374.4. Samples: 15444200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:21:16,869][16446] Avg episode reward: [(0, '4990.747')]
[2022-07-07 04:21:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7733248. Throughput: 0: 3450.8. Samples: 15466136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:21:21,869][16446] Avg episode reward: [(0, '5024.316')]
[2022-07-07 04:21:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7741440. Throughput: 0: 3301.0. Samples: 15482856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:21:26,869][16446] Avg episode reward: [(0, '4993.998')]
[2022-07-07 04:21:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7749632. Throughput: 0: 3305.8. Samples: 15492048. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:21:31,869][16446] Avg episode reward: [(0, '4972.105')]
[2022-07-07 04:21:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7757824. Throughput: 0: 3401.8. Samples: 15515264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:21:36,868][16446] Avg episode reward: [(0, '4914.221')]
[2022-07-07 04:21:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7766016. Throughput: 0: 3389.5. Samples: 15536976. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:21:41,869][16446] Avg episode reward: [(0, '4896.292')]
[2022-07-07 04:21:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7774208. Throughput: 0: 3353.0. Samples: 15545296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:21:46,868][16446] Avg episode reward: [(0, '4816.250')]
[2022-07-07 04:21:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 7786496. Throughput: 0: 3396.3. Samples: 15566408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:21:51,869][16446] Avg episode reward: [(0, '4767.842')]
[2022-07-07 04:21:56,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.4, 300 sec: 1680.0). Total num frames: 7790592. Throughput: 0: 3448.6. Samples: 15588616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:21:56,870][16446] Avg episode reward: [(0, '4773.641')]
[2022-07-07 04:22:01,870][16446] Fps is (10 sec: 1228.5, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7798784. Throughput: 0: 3408.0. Samples: 15597568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:01,871][16446] Avg episode reward: [(0, '4832.033')]
[2022-07-07 04:22:06,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7806976. Throughput: 0: 3296.7. Samples: 15614488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:06,868][16446] Avg episode reward: [(0, '4947.571')]
[2022-07-07 04:22:11,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7815168. Throughput: 0: 3408.0. Samples: 15636216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:11,871][16446] Avg episode reward: [(0, '4963.810')]
[2022-07-07 04:22:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7827456. Throughput: 0: 3439.6. Samples: 15646832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:16,869][16446] Avg episode reward: [(0, '4985.579')]
[2022-07-07 04:22:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7835648. Throughput: 0: 3419.6. Samples: 15669144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:21,869][16446] Avg episode reward: [(0, '5044.061')]
[2022-07-07 04:22:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7843840. Throughput: 0: 3343.3. Samples: 15687424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:26,869][16446] Avg episode reward: [(0, '5162.630')]
[2022-07-07 04:22:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7852032. Throughput: 0: 3345.2. Samples: 15695832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:31,869][16446] Avg episode reward: [(0, '5270.204')]
[2022-07-07 04:22:36,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7856128. Throughput: 0: 3319.8. Samples: 15715800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:36,869][16446] Avg episode reward: [(0, '5215.964')]
[2022-07-07 04:22:41,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1680.0). Total num frames: 7868416. Throughput: 0: 3290.2. Samples: 15736672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:41,870][16446] Avg episode reward: [(0, '5267.377')]
[2022-07-07 04:22:46,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7872512. Throughput: 0: 3276.3. Samples: 15745000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:46,870][16446] Avg episode reward: [(0, '5265.793')]
[2022-07-07 04:22:51,868][16446] Fps is (10 sec: 1229.0, 60 sec: 1570.1, 300 sec: 1666.2). Total num frames: 7880704. Throughput: 0: 3323.6. Samples: 15764048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:51,869][16446] Avg episode reward: [(0, '5279.621')]
[2022-07-07 04:22:56,868][16446] Fps is (10 sec: 2048.3, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7892992. Throughput: 0: 3310.6. Samples: 15785192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:22:56,869][16446] Avg episode reward: [(0, '5236.217')]
[2022-07-07 04:23:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7901184. Throughput: 0: 3288.2. Samples: 15794800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:23:01,869][16446] Avg episode reward: [(0, '5272.065')]
[2022-07-07 04:23:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7909376. Throughput: 0: 3199.6. Samples: 15813128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:23:06,868][16446] Avg episode reward: [(0, '5257.872')]
[2022-07-07 04:23:11,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 7913472. Throughput: 0: 3261.5. Samples: 15834192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:23:11,869][16446] Avg episode reward: [(0, '5250.082')]
[2022-07-07 04:23:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 7925760. Throughput: 0: 3280.9. Samples: 15843472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:23:16,869][16446] Avg episode reward: [(0, '5215.469')]
[2022-07-07 04:23:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 7933952. Throughput: 0: 3325.2. Samples: 15865432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:23:21,869][16446] Avg episode reward: [(0, '5228.322')]
[2022-07-07 04:23:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 7942144. Throughput: 0: 3279.9. Samples: 15884264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:23:26,869][16446] Avg episode reward: [(0, '5117.395')]
[2022-07-07 04:23:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 7950336. Throughput: 0: 3314.2. Samples: 15894136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:23:31,869][16446] Avg episode reward: [(0, '5125.134')]
[2022-07-07 04:23:36,874][16446] Fps is (10 sec: 1637.4, 60 sec: 1706.5, 300 sec: 1680.0). Total num frames: 7958528. Throughput: 0: 3364.7. Samples: 15915480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:23:36,875][16446] Avg episode reward: [(0, '5132.366')]
[2022-07-07 04:23:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 7966720. Throughput: 0: 3329.1. Samples: 15935000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:23:41,869][16446] Avg episode reward: [(0, '5200.936')]
[2022-07-07 04:23:46,868][16446] Fps is (10 sec: 1639.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7974912. Throughput: 0: 3286.9. Samples: 15942712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:23:46,869][16446] Avg episode reward: [(0, '5139.421')]
[2022-07-07 04:23:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 7983104. Throughput: 0: 3341.9. Samples: 15963512. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:23:51,868][16446] Avg episode reward: [(0, '5151.527')]
[2022-07-07 04:23:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 7991296. Throughput: 0: 3368.9. Samples: 15985792. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:23:56,869][16446] Avg episode reward: [(0, '5183.582')]
[2022-07-07 04:24:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 7999488. Throughput: 0: 3384.2. Samples: 15995760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:01,869][16446] Avg episode reward: [(0, '5193.979')]
[2022-07-07 04:24:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 8007680. Throughput: 0: 3319.8. Samples: 16014824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:06,869][16446] Avg episode reward: [(0, '5146.123')]
[2022-07-07 04:24:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8015872. Throughput: 0: 3275.6. Samples: 16031664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:11,869][16446] Avg episode reward: [(0, '5191.804')]
[2022-07-07 04:24:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 8024064. Throughput: 0: 3285.5. Samples: 16041984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:16,869][16446] Avg episode reward: [(0, '5150.473')]
[2022-07-07 04:24:21,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.3, 300 sec: 1680.0). Total num frames: 8032256. Throughput: 0: 3294.9. Samples: 16063736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:21,871][16446] Avg episode reward: [(0, '5123.131')]
[2022-07-07 04:24:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 8040448. Throughput: 0: 3250.8. Samples: 16081288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:26,869][16446] Avg episode reward: [(0, '5171.228')]
[2022-07-07 04:24:31,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8048640. Throughput: 0: 3317.7. Samples: 16092008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:31,868][16446] Avg episode reward: [(0, '5167.873')]
[2022-07-07 04:24:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.6, 300 sec: 1666.2). Total num frames: 8056832. Throughput: 0: 3310.4. Samples: 16112480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:36,869][16446] Avg episode reward: [(0, '5128.522')]
[2022-07-07 04:24:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8065024. Throughput: 0: 3222.2. Samples: 16130792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:41,869][16446] Avg episode reward: [(0, '5153.254')]
[2022-07-07 04:24:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8073216. Throughput: 0: 3279.3. Samples: 16143328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:24:46,869][16446] Avg episode reward: [(0, '5185.618')]
[2022-07-07 04:24:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8081408. Throughput: 0: 3288.4. Samples: 16162800. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:24:51,868][16446] Avg episode reward: [(0, '5229.031')]
[2022-07-07 04:24:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8089600. Throughput: 0: 3365.0. Samples: 16183088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:24:56,869][16446] Avg episode reward: [(0, '5233.925')]
[2022-07-07 04:25:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8097792. Throughput: 0: 3375.1. Samples: 16193864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:25:01,869][16446] Avg episode reward: [(0, '5234.444')]
[2022-07-07 04:25:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8105984. Throughput: 0: 3318.4. Samples: 16213056. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:25:06,869][16446] Avg episode reward: [(0, '5230.279')]
[2022-07-07 04:25:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8114176. Throughput: 0: 3402.0. Samples: 16234376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:25:11,869][16446] Avg episode reward: [(0, '5309.422')]
[2022-07-07 04:25:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8122368. Throughput: 0: 3390.9. Samples: 16244600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:25:16,869][16446] Avg episode reward: [(0, '5218.346')]
[2022-07-07 04:25:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1666.2). Total num frames: 8130560. Throughput: 0: 3359.5. Samples: 16263656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:25:21,868][16446] Avg episode reward: [(0, '5222.761')]
[2022-07-07 04:25:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8138752. Throughput: 0: 3420.4. Samples: 16284712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:25:26,870][16446] Avg episode reward: [(0, '5197.717')]
[2022-07-07 04:25:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8146944. Throughput: 0: 3345.8. Samples: 16293888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:25:31,870][16446] Avg episode reward: [(0, '5224.696')]
[2022-07-07 04:25:36,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8159232. Throughput: 0: 3357.7. Samples: 16313896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:25:36,868][16446] Avg episode reward: [(0, '5127.422')]
[2022-07-07 04:25:41,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8167424. Throughput: 0: 3371.2. Samples: 16334792. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:25:41,869][16446] Avg episode reward: [(0, '5146.007')]
[2022-07-07 04:25:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8175616. Throughput: 0: 3340.4. Samples: 16344184. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:25:46,868][16446] Avg episode reward: [(0, '5104.876')]
[2022-07-07 04:25:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8183808. Throughput: 0: 3365.2. Samples: 16364488. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:25:51,869][16446] Avg episode reward: [(0, '5149.767')]
[2022-07-07 04:25:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8192000. Throughput: 0: 3325.0. Samples: 16384000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:25:56,869][16446] Avg episode reward: [(0, '5233.287')]
[2022-07-07 04:26:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8200192. Throughput: 0: 3310.2. Samples: 16393560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:26:01,869][16446] Avg episode reward: [(0, '5168.665')]
[2022-07-07 04:26:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8208384. Throughput: 0: 3350.4. Samples: 16414424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:26:06,869][16446] Avg episode reward: [(0, '5123.173')]
[2022-07-07 04:26:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8216576. Throughput: 0: 3310.0. Samples: 16433664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:26:11,869][16446] Avg episode reward: [(0, '5071.332')]
[2022-07-07 04:26:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8224768. Throughput: 0: 3329.6. Samples: 16443720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:26:16,868][16446] Avg episode reward: [(0, '5045.186')]
[2022-07-07 04:26:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8232960. Throughput: 0: 3372.4. Samples: 16465656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:26:21,869][16446] Avg episode reward: [(0, '5063.721')]
[2022-07-07 04:26:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8241152. Throughput: 0: 3305.2. Samples: 16483528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:26:26,869][16446] Avg episode reward: [(0, '5085.713')]
[2022-07-07 04:26:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8249344. Throughput: 0: 3322.7. Samples: 16493704. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:26:31,869][16446] Avg episode reward: [(0, '5199.501')]
[2022-07-07 04:26:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8257536. Throughput: 0: 3329.8. Samples: 16514328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:26:36,868][16446] Avg episode reward: [(0, '5197.494')]
[2022-07-07 04:26:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8265728. Throughput: 0: 3358.9. Samples: 16535152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:26:41,869][16446] Avg episode reward: [(0, '5238.170')]
[2022-07-07 04:26:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 8273920. Throughput: 0: 3415.6. Samples: 16547264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:26:46,869][16446] Avg episode reward: [(0, '5181.778')]
[2022-07-07 04:26:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8282112. Throughput: 0: 3328.0. Samples: 16564184. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:26:51,869][16446] Avg episode reward: [(0, '5190.050')]
[2022-07-07 04:26:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8290304. Throughput: 0: 3392.7. Samples: 16586336. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:26:56,869][16446] Avg episode reward: [(0, '5242.008')]
[2022-07-07 04:27:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8298496. Throughput: 0: 3403.2. Samples: 16596864. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:27:01,869][16446] Avg episode reward: [(0, '5259.220')]
[2022-07-07 04:27:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 8306688. Throughput: 0: 3282.7. Samples: 16613376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:27:06,868][16446] Avg episode reward: [(0, '5355.598')]
[2022-07-07 04:27:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 8314880. Throughput: 0: 3390.8. Samples: 16636112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0)
[2022-07-07 04:27:11,869][16446] Avg episode reward: [(0, '5429.218')]
[2022-07-07 04:27:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8327168. Throughput: 0: 3384.7. Samples: 16646016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:27:16,869][16446] Avg episode reward: [(0, '5418.216')]
[2022-07-07 04:27:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 8331264. Throughput: 0: 3366.4. Samples: 16665816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:27:21,869][16446] Avg episode reward: [(0, '5425.245')]
[2022-07-07 04:27:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8343552. Throughput: 0: 3374.9. Samples: 16687024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:27:26,869][16446] Avg episode reward: [(0, '5332.444')]
[2022-07-07 04:27:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8351744. Throughput: 0: 3289.6. Samples: 16695296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:27:31,869][16446] Avg episode reward: [(0, '5328.999')]
[2022-07-07 04:27:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8359936. Throughput: 0: 3414.2. Samples: 16717824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:27:36,869][16446] Avg episode reward: [(0, '5322.195')]
[2022-07-07 04:27:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8368128. Throughput: 0: 3354.7. Samples: 16737296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:27:41,869][16446] Avg episode reward: [(0, '5365.966')]
[2022-07-07 04:27:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8376320. Throughput: 0: 3386.8. Samples: 16749272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:27:46,869][16446] Avg episode reward: [(0, '5357.314')]
[2022-07-07 04:27:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8384512. Throughput: 0: 3467.9. Samples: 16769432. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:27:51,869][16446] Avg episode reward: [(0, '5408.188')]
[2022-07-07 04:27:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 8392704. Throughput: 0: 3472.0. Samples: 16792352. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:27:56,869][16446] Avg episode reward: [(0, '5338.200')]
[2022-07-07 04:28:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1680.1). Total num frames: 8404992. Throughput: 0: 3466.1. Samples: 16801992. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:28:01,869][16446] Avg episode reward: [(0, '5350.268')]
[2022-07-07 04:28:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8409088. Throughput: 0: 3434.7. Samples: 16820376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:28:06,869][16446] Avg episode reward: [(0, '5316.259')]
[2022-07-07 04:28:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1680.1). Total num frames: 8421376. Throughput: 0: 3427.7. Samples: 16841272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:28:11,869][16446] Avg episode reward: [(0, '5370.689')]
[2022-07-07 04:28:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8429568. Throughput: 0: 3452.3. Samples: 16850648. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:28:16,869][16446] Avg episode reward: [(0, '5389.934')]
[2022-07-07 04:28:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1680.1). Total num frames: 8437760. Throughput: 0: 3425.2. Samples: 16871960. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:28:21,868][16446] Avg episode reward: [(0, '5438.600')]
[2022-07-07 04:28:26,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8445952. Throughput: 0: 3452.1. Samples: 16892640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:28:26,869][16446] Avg episode reward: [(0, '5425.070')]
[2022-07-07 04:28:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8454144. Throughput: 0: 3417.1. Samples: 16903040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:28:31,869][16446] Avg episode reward: [(0, '5369.428')]
[2022-07-07 04:28:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8462336. Throughput: 0: 3394.0. Samples: 16922160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:28:36,869][16446] Avg episode reward: [(0, '5362.674')]
[2022-07-07 04:28:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 8470528. Throughput: 0: 3314.1. Samples: 16941488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:28:41,869][16446] Avg episode reward: [(0, '5366.484')]
[2022-07-07 04:28:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1693.9). Total num frames: 8482816. Throughput: 0: 3343.1. Samples: 16952432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:28:46,869][16446] Avg episode reward: [(0, '5447.809')]
[2022-07-07 04:28:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1693.9). Total num frames: 8491008. Throughput: 0: 3586.7. Samples: 16981776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:28:51,869][16446] Avg episode reward: [(0, '5405.413')]
[2022-07-07 04:28:56,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1843.2, 300 sec: 1707.8). Total num frames: 8503296. Throughput: 0: 3731.2. Samples: 17009176. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:28:56,869][16446] Avg episode reward: [(0, '5449.584')]
[2022-07-07 04:29:01,868][16446] Fps is (10 sec: 2457.6, 60 sec: 1843.2, 300 sec: 1721.7). Total num frames: 8515584. Throughput: 0: 3834.3. Samples: 17023192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:29:01,869][16446] Avg episode reward: [(0, '5484.398')]
[2022-07-07 04:29:06,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1911.5, 300 sec: 1721.7). Total num frames: 8523776. Throughput: 0: 3899.9. Samples: 17047456. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:29:06,869][16446] Avg episode reward: [(0, '5486.172')]
[2022-07-07 04:29:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1721.7). Total num frames: 8531968. Throughput: 0: 3808.0. Samples: 17064000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:29:11,869][16446] Avg episode reward: [(0, '5550.549')]
[2022-07-07 04:29:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1721.7). Total num frames: 8540160. Throughput: 0: 3858.8. Samples: 17076688. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:29:16,868][16446] Avg episode reward: [(0, '5635.779')]
[2022-07-07 04:29:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1721.7). Total num frames: 8548352. Throughput: 0: 3930.1. Samples: 17099016. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:29:21,868][16446] Avg episode reward: [(0, '5610.538')]
[2022-07-07 04:29:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1843.2, 300 sec: 1721.7). Total num frames: 8556544. Throughput: 0: 3927.5. Samples: 17118224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:29:26,869][16446] Avg episode reward: [(0, '5547.397')]
[2022-07-07 04:29:31,869][16446] Fps is (10 sec: 2047.8, 60 sec: 1911.4, 300 sec: 1735.6). Total num frames: 8568832. Throughput: 0: 3934.0. Samples: 17129464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:29:31,869][16446] Avg episode reward: [(0, '5478.200')]
[2022-07-07 04:29:36,868][16446] Fps is (10 sec: 2457.6, 60 sec: 1979.7, 300 sec: 1749.5). Total num frames: 8581120. Throughput: 0: 3897.2. Samples: 17157152. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:29:36,869][16446] Avg episode reward: [(0, '5405.354')]
[2022-07-07 04:29:41,869][16446] Fps is (10 sec: 2047.9, 60 sec: 1979.7, 300 sec: 1749.5). Total num frames: 8589312. Throughput: 0: 3763.4. Samples: 17178536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:29:41,870][16446] Avg episode reward: [(0, '5397.009')]
[2022-07-07 04:29:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1911.5, 300 sec: 1749.5). Total num frames: 8597504. Throughput: 0: 3664.2. Samples: 17188080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:29:46,868][16446] Avg episode reward: [(0, '5359.818')]
[2022-07-07 04:29:51,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1911.5, 300 sec: 1749.5). Total num frames: 8605696. Throughput: 0: 3603.9. Samples: 17209632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:29:51,868][16446] Avg episode reward: [(0, '5352.138')]
[2022-07-07 04:29:56,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1843.2, 300 sec: 1749.5). Total num frames: 8613888. Throughput: 0: 3639.3. Samples: 17227768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:29:56,872][16446] Avg episode reward: [(0, '5262.537')]
[2022-07-07 04:30:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1749.5). Total num frames: 8622080. Throughput: 0: 3605.7. Samples: 17238944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:01,869][16446] Avg episode reward: [(0, '5275.526')]
[2022-07-07 04:30:06,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1774.9, 300 sec: 1749.5). Total num frames: 8630272. Throughput: 0: 3520.4. Samples: 17257432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:06,868][16446] Avg episode reward: [(0, '5212.170')]
[2022-07-07 04:30:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1749.5). Total num frames: 8638464. Throughput: 0: 3525.7. Samples: 17276880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:11,869][16446] Avg episode reward: [(0, '5163.518')]
[2022-07-07 04:30:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1749.5). Total num frames: 8646656. Throughput: 0: 3469.0. Samples: 17285568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:16,869][16446] Avg episode reward: [(0, '5187.733')]
[2022-07-07 04:30:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1749.5). Total num frames: 8654848. Throughput: 0: 3358.6. Samples: 17308288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:21,871][16446] Avg episode reward: [(0, '5249.289')]
[2022-07-07 04:30:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1774.9, 300 sec: 1749.5). Total num frames: 8663040. Throughput: 0: 3328.1. Samples: 17328296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:26,869][16446] Avg episode reward: [(0, '5229.308')]
[2022-07-07 04:30:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 8671232. Throughput: 0: 3320.4. Samples: 17337496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:31,869][16446] Avg episode reward: [(0, '5251.376')]
[2022-07-07 04:30:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8679424. Throughput: 0: 3296.2. Samples: 17357960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:30:36,869][16446] Avg episode reward: [(0, '5247.774')]
[2022-07-07 04:30:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8687616. Throughput: 0: 3276.5. Samples: 17375208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:30:41,869][16446] Avg episode reward: [(0, '5276.515')]
[2022-07-07 04:30:46,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.3, 300 sec: 1735.6). Total num frames: 8695808. Throughput: 0: 3249.9. Samples: 17385200. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:30:46,871][16446] Avg episode reward: [(0, '5272.314')]
[2022-07-07 04:30:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8704000. Throughput: 0: 3259.2. Samples: 17404096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:30:51,868][16446] Avg episode reward: [(0, '5231.278')]
[2022-07-07 04:30:56,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8712192. Throughput: 0: 3276.1. Samples: 17424304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:30:56,872][16446] Avg episode reward: [(0, '5305.575')]
[2022-07-07 04:31:01,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8720384. Throughput: 0: 3293.1. Samples: 17433760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:31:01,870][16446] Avg episode reward: [(0, '5272.324')]
[2022-07-07 04:31:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1721.7). Total num frames: 8724480. Throughput: 0: 3191.1. Samples: 17451888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:31:06,869][16446] Avg episode reward: [(0, '5344.349')]
[2022-07-07 04:31:11,868][16446] Fps is (10 sec: 1228.9, 60 sec: 1570.1, 300 sec: 1721.7). Total num frames: 8732672. Throughput: 0: 3197.7. Samples: 17472192. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:31:11,869][16446] Avg episode reward: [(0, '5353.425')]
[2022-07-07 04:31:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8744960. Throughput: 0: 3200.7. Samples: 17481528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:31:16,869][16446] Avg episode reward: [(0, '5388.480')]
[2022-07-07 04:31:21,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8753152. Throughput: 0: 3215.5. Samples: 17502656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:31:21,869][16446] Avg episode reward: [(0, '5440.399')]
[2022-07-07 04:31:26,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8761344. Throughput: 0: 3274.5. Samples: 17522560. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:31:26,869][16446] Avg episode reward: [(0, '5446.662')]
[2022-07-07 04:31:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8769536. Throughput: 0: 3282.4. Samples: 17532896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:31:31,868][16446] Avg episode reward: [(0, '5523.920')]
[2022-07-07 04:31:36,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8777728. Throughput: 0: 3308.1. Samples: 17552960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:31:36,868][16446] Avg episode reward: [(0, '5507.426')]
[2022-07-07 04:31:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8785920. Throughput: 0: 3301.2. Samples: 17572856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:31:41,869][16446] Avg episode reward: [(0, '5563.451')]
[2022-07-07 04:31:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1735.6). Total num frames: 8794112. Throughput: 0: 3341.1. Samples: 17584104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:31:46,869][16446] Avg episode reward: [(0, '5494.842')]
[2022-07-07 04:31:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8802304. Throughput: 0: 3382.6. Samples: 17604104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:31:51,868][16446] Avg episode reward: [(0, '5484.790')]
[2022-07-07 04:31:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8810496. Throughput: 0: 3377.4. Samples: 17624176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:31:56,869][16446] Avg episode reward: [(0, '5477.759')]
[2022-07-07 04:32:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8818688. Throughput: 0: 3400.7. Samples: 17634560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:32:01,869][16446] Avg episode reward: [(0, '5402.865')]
[2022-07-07 04:32:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 8826880. Throughput: 0: 3346.3. Samples: 17653240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:32:06,869][16446] Avg episode reward: [(0, '5455.794')]
[2022-07-07 04:32:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 8835072. Throughput: 0: 3324.3. Samples: 17672152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:32:11,869][16446] Avg episode reward: [(0, '5458.712')]
[2022-07-07 04:32:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1735.6). Total num frames: 8843264. Throughput: 0: 3373.3. Samples: 17684696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:32:16,869][16446] Avg episode reward: [(0, '5472.076')]
[2022-07-07 04:32:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 8851456. Throughput: 0: 3337.8. Samples: 17703160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:32:21,869][16446] Avg episode reward: [(0, '5460.943')]
[2022-07-07 04:32:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 8859648. Throughput: 0: 3386.7. Samples: 17725256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:32:26,869][16446] Avg episode reward: [(0, '5495.240')]
[2022-07-07 04:32:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 8867840. Throughput: 0: 3336.4. Samples: 17734240. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:32:31,868][16446] Avg episode reward: [(0, '5501.692')]
[2022-07-07 04:32:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 8876032. Throughput: 0: 3312.0. Samples: 17753144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:32:36,869][16446] Avg episode reward: [(0, '5451.124')]
[2022-07-07 04:32:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 8884224. Throughput: 0: 3334.6. Samples: 17774232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:32:41,869][16446] Avg episode reward: [(0, '5486.892')]
[2022-07-07 04:32:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 8892416. Throughput: 0: 3332.6. Samples: 17784528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:32:46,868][16446] Avg episode reward: [(0, '5417.471')]
[2022-07-07 04:32:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1721.7). Total num frames: 8900608. Throughput: 0: 3324.3. Samples: 17802832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:32:51,869][16446] Avg episode reward: [(0, '5484.121')]
[2022-07-07 04:32:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1707.8). Total num frames: 8908800. Throughput: 0: 3379.2. Samples: 17824216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:32:56,869][16446] Avg episode reward: [(0, '5476.816')]
[2022-07-07 04:33:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1735.6). Total num frames: 8921088. Throughput: 0: 3325.5. Samples: 17834344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:01,868][16446] Avg episode reward: [(0, '5565.346')]
[2022-07-07 04:33:06,868][16446] Fps is (10 sec: 2048.1, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 8929280. Throughput: 0: 3373.5. Samples: 17854968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:06,869][16446] Avg episode reward: [(0, '5570.074')]
[2022-07-07 04:33:11,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 8937472. Throughput: 0: 3326.4. Samples: 17874944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:11,869][16446] Avg episode reward: [(0, '5522.648')]
[2022-07-07 04:33:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 8945664. Throughput: 0: 3356.8. Samples: 17885296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:16,869][16446] Avg episode reward: [(0, '5482.648')]
[2022-07-07 04:33:21,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1706.6, 300 sec: 1721.7). Total num frames: 8953856. Throughput: 0: 3411.6. Samples: 17906672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:21,870][16446] Avg episode reward: [(0, '5447.949')]
[2022-07-07 04:33:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 8962048. Throughput: 0: 3363.4. Samples: 17925584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:26,869][16446] Avg episode reward: [(0, '5422.654')]
[2022-07-07 04:33:31,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 8970240. Throughput: 0: 3362.1. Samples: 17935824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:31,869][16446] Avg episode reward: [(0, '5401.183')]
[2022-07-07 04:33:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1721.7). Total num frames: 8978432. Throughput: 0: 3408.5. Samples: 17956216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:36,869][16446] Avg episode reward: [(0, '5440.828')]
[2022-07-07 04:33:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 8986624. Throughput: 0: 3437.5. Samples: 17978904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:33:41,869][16446] Avg episode reward: [(0, '5590.116')]
[2022-07-07 04:33:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1707.8). Total num frames: 8994816. Throughput: 0: 3402.8. Samples: 17987472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:33:46,868][16446] Avg episode reward: [(0, '5540.185')]
[2022-07-07 04:33:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 9003008. Throughput: 0: 3411.6. Samples: 18008488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:33:51,868][16446] Avg episode reward: [(0, '5546.865')]
[2022-07-07 04:33:56,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1774.9, 300 sec: 1693.9). Total num frames: 9015296. Throughput: 0: 3454.8. Samples: 18030408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:33:56,869][16446] Avg episode reward: [(0, '5530.373')]
[2022-07-07 04:34:01,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 9023488. Throughput: 0: 3422.6. Samples: 18039312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:34:01,869][16446] Avg episode reward: [(0, '5474.913')]
[2022-07-07 04:34:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 9031680. Throughput: 0: 3390.0. Samples: 18059216. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:34:06,869][16446] Avg episode reward: [(0, '5519.710')]
[2022-07-07 04:34:11,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 9035776. Throughput: 0: 3406.6. Samples: 18078880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:34:11,869][16446] Avg episode reward: [(0, '5486.096')]
[2022-07-07 04:34:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 9048064. Throughput: 0: 3383.1. Samples: 18088064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:34:16,869][16446] Avg episode reward: [(0, '5504.070')]
[2022-07-07 04:34:21,868][16446] Fps is (10 sec: 2048.1, 60 sec: 1706.7, 300 sec: 1693.9). Total num frames: 9056256. Throughput: 0: 3387.2. Samples: 18108640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:34:21,869][16446] Avg episode reward: [(0, '5520.179')]
[2022-07-07 04:34:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1680.1). Total num frames: 9064448. Throughput: 0: 3325.5. Samples: 18128552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:34:26,870][16446] Avg episode reward: [(0, '5471.124')]
[2022-07-07 04:34:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9072640. Throughput: 0: 3352.9. Samples: 18138352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:34:31,868][16446] Avg episode reward: [(0, '5398.735')]
[2022-07-07 04:34:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9080832. Throughput: 0: 3378.5. Samples: 18160520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:34:36,869][16446] Avg episode reward: [(0, '5338.890')]
[2022-07-07 04:34:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9089024. Throughput: 0: 3293.3. Samples: 18178608. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:34:41,869][16446] Avg episode reward: [(0, '5339.474')]
[2022-07-07 04:34:46,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1706.6, 300 sec: 1666.2). Total num frames: 9097216. Throughput: 0: 3322.1. Samples: 18188816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:34:46,871][16446] Avg episode reward: [(0, '5234.663')]
[2022-07-07 04:34:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9105408. Throughput: 0: 3301.5. Samples: 18207784. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:34:51,868][16446] Avg episode reward: [(0, '5259.494')]
[2022-07-07 04:34:56,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9113600. Throughput: 0: 3296.0. Samples: 18227200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:34:56,869][16446] Avg episode reward: [(0, '5217.718')]
[2022-07-07 04:35:01,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9121792. Throughput: 0: 3303.8. Samples: 18236736. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:35:01,869][16446] Avg episode reward: [(0, '5169.196')]
[2022-07-07 04:35:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9129984. Throughput: 0: 3270.6. Samples: 18255816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:35:06,869][16446] Avg episode reward: [(0, '5154.582')]
[2022-07-07 04:35:11,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9138176. Throughput: 0: 3272.4. Samples: 18275808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:35:11,868][16446] Avg episode reward: [(0, '5177.714')]
[2022-07-07 04:35:16,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 9142272. Throughput: 0: 3244.4. Samples: 18284352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:35:16,869][16446] Avg episode reward: [(0, '5148.390')]
[2022-07-07 04:35:21,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 9150464. Throughput: 0: 3195.4. Samples: 18304312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:35:21,868][16446] Avg episode reward: [(0, '5157.173')]
[2022-07-07 04:35:26,870][16446] Fps is (10 sec: 1638.0, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 9158656. Throughput: 0: 3247.3. Samples: 18324744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:35:26,871][16446] Avg episode reward: [(0, '5096.123')]
[2022-07-07 04:35:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9170944. Throughput: 0: 3222.6. Samples: 18333824. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:35:31,868][16446] Avg episode reward: [(0, '5150.596')]
[2022-07-07 04:35:36,868][16446] Fps is (10 sec: 2048.5, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9179136. Throughput: 0: 3239.5. Samples: 18353560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:35:36,868][16446] Avg episode reward: [(0, '5198.064')]
[2022-07-07 04:35:41,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 9183232. Throughput: 0: 3247.6. Samples: 18373344. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:35:41,869][16446] Avg episode reward: [(0, '5246.011')]
[2022-07-07 04:35:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1666.2). Total num frames: 9195520. Throughput: 0: 3242.6. Samples: 18382648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:35:46,868][16446] Avg episode reward: [(0, '5218.425')]
[2022-07-07 04:35:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9203712. Throughput: 0: 3266.0. Samples: 18402784. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:35:51,868][16446] Avg episode reward: [(0, '5243.914')]
[2022-07-07 04:35:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9211904. Throughput: 0: 3276.8. Samples: 18423264. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:35:56,869][16446] Avg episode reward: [(0, '5254.441')]
[2022-07-07 04:36:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1680.1). Total num frames: 9220096. Throughput: 0: 3284.8. Samples: 18432168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:01,868][16446] Avg episode reward: [(0, '5353.015')]
[2022-07-07 04:36:06,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1666.2). Total num frames: 9224192. Throughput: 0: 3247.1. Samples: 18450432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:06,868][16446] Avg episode reward: [(0, '5375.655')]
[2022-07-07 04:36:11,868][16446] Fps is (10 sec: 1228.8, 60 sec: 1570.1, 300 sec: 1652.3). Total num frames: 9232384. Throughput: 0: 3260.6. Samples: 18471464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:11,868][16446] Avg episode reward: [(0, '5394.013')]
[2022-07-07 04:36:16,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9244672. Throughput: 0: 3269.9. Samples: 18480968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:16,868][16446] Avg episode reward: [(0, '5434.609')]
[2022-07-07 04:36:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9248768. Throughput: 0: 3278.9. Samples: 18501112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:21,869][16446] Avg episode reward: [(0, '5472.660')]
[2022-07-07 04:36:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9261056. Throughput: 0: 3293.3. Samples: 18521544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:26,869][16446] Avg episode reward: [(0, '5493.683')]
[2022-07-07 04:36:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9269248. Throughput: 0: 3277.7. Samples: 18530144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:31,868][16446] Avg episode reward: [(0, '5478.605')]
[2022-07-07 04:36:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9277440. Throughput: 0: 3289.2. Samples: 18550800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:36,869][16446] Avg episode reward: [(0, '5456.583')]
[2022-07-07 04:36:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9285632. Throughput: 0: 3278.9. Samples: 18570816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:41,869][16446] Avg episode reward: [(0, '5448.475')]
[2022-07-07 04:36:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9293824. Throughput: 0: 3302.6. Samples: 18580784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:46,869][16446] Avg episode reward: [(0, '5441.864')]
[2022-07-07 04:36:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9302016. Throughput: 0: 3355.2. Samples: 18601416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:36:51,869][16446] Avg episode reward: [(0, '5414.213')]
[2022-07-07 04:36:56,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.3, 300 sec: 1666.2). Total num frames: 9310208. Throughput: 0: 3331.2. Samples: 18621376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:36:56,871][16446] Avg episode reward: [(0, '5391.683')]
[2022-07-07 04:37:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9318400. Throughput: 0: 3347.4. Samples: 18631600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:37:01,869][16446] Avg episode reward: [(0, '5388.679')]
[2022-07-07 04:37:06,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9326592. Throughput: 0: 3320.0. Samples: 18650512. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:37:06,869][16446] Avg episode reward: [(0, '5328.649')]
[2022-07-07 04:37:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9334784. Throughput: 0: 3325.9. Samples: 18671208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:37:11,869][16446] Avg episode reward: [(0, '5372.363')]
[2022-07-07 04:37:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9342976. Throughput: 0: 3366.4. Samples: 18681632. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:37:16,869][16446] Avg episode reward: [(0, '5361.902')]
[2022-07-07 04:37:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9351168. Throughput: 0: 3364.1. Samples: 18702184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:21,869][16446] Avg episode reward: [(0, '5331.750')]
[2022-07-07 04:37:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9359360. Throughput: 0: 3343.5. Samples: 18721272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:26,871][16446] Avg episode reward: [(0, '5323.616')]
[2022-07-07 04:37:31,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9367552. Throughput: 0: 3356.4. Samples: 18731824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:31,870][16446] Avg episode reward: [(0, '5322.694')]
[2022-07-07 04:37:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9375744. Throughput: 0: 3331.4. Samples: 18751328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:36,869][16446] Avg episode reward: [(0, '5372.751')]
[2022-07-07 04:37:41,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9383936. Throughput: 0: 3341.4. Samples: 18771728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:41,869][16446] Avg episode reward: [(0, '5466.282')]
[2022-07-07 04:37:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9392128. Throughput: 0: 3363.6. Samples: 18782960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:46,869][16446] Avg episode reward: [(0, '5445.307')]
[2022-07-07 04:37:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9400320. Throughput: 0: 3375.5. Samples: 18802408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:51,869][16446] Avg episode reward: [(0, '5416.488')]
[2022-07-07 04:37:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1652.3). Total num frames: 9408512. Throughput: 0: 3354.8. Samples: 18822176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:37:56,869][16446] Avg episode reward: [(0, '5418.116')]
[2022-07-07 04:38:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9416704. Throughput: 0: 3346.7. Samples: 18832232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:38:01,869][16446] Avg episode reward: [(0, '5337.178')]
[2022-07-07 04:38:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9424896. Throughput: 0: 3296.0. Samples: 18850504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:38:06,869][16446] Avg episode reward: [(0, '5434.633')]
[2022-07-07 04:38:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9433088. Throughput: 0: 3350.4. Samples: 18872040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:38:11,869][16446] Avg episode reward: [(0, '5395.489')]
[2022-07-07 04:38:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9441280. Throughput: 0: 3336.6. Samples: 18881968. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:38:16,868][16446] Avg episode reward: [(0, '5464.854')]
[2022-07-07 04:38:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9449472. Throughput: 0: 3349.2. Samples: 18902040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:38:21,868][16446] Avg episode reward: [(0, '5469.994')]
[2022-07-07 04:38:26,869][16446] Fps is (10 sec: 2047.7, 60 sec: 1706.6, 300 sec: 1666.2). Total num frames: 9461760. Throughput: 0: 3364.2. Samples: 18923120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:38:26,870][16446] Avg episode reward: [(0, '5498.668')]
[2022-07-07 04:38:31,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9469952. Throughput: 0: 3320.5. Samples: 18932384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:38:31,869][16446] Avg episode reward: [(0, '5508.752')]
[2022-07-07 04:38:36,868][16446] Fps is (10 sec: 1228.9, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9474048. Throughput: 0: 3338.7. Samples: 18952648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0)
[2022-07-07 04:38:36,869][16446] Avg episode reward: [(0, '5468.879')]
[2022-07-07 04:38:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9486336. Throughput: 0: 3338.5. Samples: 18972408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:38:41,869][16446] Avg episode reward: [(0, '5481.234')]
[2022-07-07 04:38:46,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1666.2). Total num frames: 9494528. Throughput: 0: 3305.4. Samples: 18980976. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:38:46,869][16446] Avg episode reward: [(0, '5468.773')]
[2022-07-07 04:38:51,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1706.6, 300 sec: 1652.3). Total num frames: 9502720. Throughput: 0: 3386.1. Samples: 19002888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:38:51,872][16446] Avg episode reward: [(0, '5492.207')]
[2022-07-07 04:38:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 9510912. Throughput: 0: 3334.9. Samples: 19022112. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:38:56,869][16446] Avg episode reward: [(0, '5426.230')]
[2022-07-07 04:39:01,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 9519104. Throughput: 0: 3375.8. Samples: 19033880. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:39:01,869][16446] Avg episode reward: [(0, '5385.791')]
[2022-07-07 04:39:06,871][16446] Fps is (10 sec: 1638.0, 60 sec: 1706.6, 300 sec: 1666.2). Total num frames: 9527296. Throughput: 0: 3342.4. Samples: 19052456. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0)
[2022-07-07 04:39:06,871][16446] Avg episode reward: [(0, '5424.452')]
[2022-07-07 04:39:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 9535488. Throughput: 0: 3321.9. Samples: 19072600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:39:11,869][16446] Avg episode reward: [(0, '5373.796')]
[2022-07-07 04:39:16,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 9543680. Throughput: 0: 3338.8. Samples: 19082632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:39:16,868][16446] Avg episode reward: [(0, '5343.008')]
[2022-07-07 04:39:21,870][16446] Fps is (10 sec: 1638.2, 60 sec: 1706.6, 300 sec: 1652.3). Total num frames: 9551872. Throughput: 0: 3323.3. Samples: 19102200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:39:21,870][16446] Avg episode reward: [(0, '5313.319')]
[2022-07-07 04:39:26,870][16446] Fps is (10 sec: 1638.1, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9560064. Throughput: 0: 3281.5. Samples: 19120080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:39:26,871][16446] Avg episode reward: [(0, '5220.377')]
[2022-07-07 04:39:31,869][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9568256. Throughput: 0: 3310.1. Samples: 19129936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:39:31,870][16446] Avg episode reward: [(0, '5245.481')]
[2022-07-07 04:39:36,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 9576448. Throughput: 0: 3278.6. Samples: 19150416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:39:36,868][16446] Avg episode reward: [(0, '5298.270')]
[2022-07-07 04:39:41,868][16446] Fps is (10 sec: 1638.6, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9584640. Throughput: 0: 3270.4. Samples: 19169280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:39:41,869][16446] Avg episode reward: [(0, '5233.616')]
[2022-07-07 04:39:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9592832. Throughput: 0: 3236.8. Samples: 19179536. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:39:46,869][16446] Avg episode reward: [(0, '5265.284')]
[2022-07-07 04:39:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1652.3). Total num frames: 9601024. Throughput: 0: 3274.0. Samples: 19199776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:39:51,869][16446] Avg episode reward: [(0, '5305.688')]
[2022-07-07 04:39:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9609216. Throughput: 0: 3240.7. Samples: 19218432. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:39:56,869][16446] Avg episode reward: [(0, '5408.256')]
[2022-07-07 04:40:01,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.3, 300 sec: 1652.3). Total num frames: 9617408. Throughput: 0: 3254.7. Samples: 19229104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0)
[2022-07-07 04:40:01,871][16446] Avg episode reward: [(0, '5413.241')]
[2022-07-07 04:40:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1652.3). Total num frames: 9625600. Throughput: 0: 3225.7. Samples: 19247352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:06,869][16446] Avg episode reward: [(0, '5372.430')]
[2022-07-07 04:40:11,870][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.3, 300 sec: 1666.2). Total num frames: 9633792. Throughput: 0: 3277.9. Samples: 19267584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:11,871][16446] Avg episode reward: [(0, '5389.046')]
[2022-07-07 04:40:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9641984. Throughput: 0: 3268.3. Samples: 19277008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:16,869][16446] Avg episode reward: [(0, '5474.396')]
[2022-07-07 04:40:21,868][16446] Fps is (10 sec: 1638.7, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9650176. Throughput: 0: 3265.2. Samples: 19297352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:21,869][16446] Avg episode reward: [(0, '5473.532')]
[2022-07-07 04:40:26,869][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9658368. Throughput: 0: 3276.8. Samples: 19316736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:26,870][16446] Avg episode reward: [(0, '5496.300')]
[2022-07-07 04:40:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9666560. Throughput: 0: 3278.0. Samples: 19327048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:31,869][16446] Avg episode reward: [(0, '5466.682')]
[2022-07-07 04:40:36,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9674752. Throughput: 0: 3272.5. Samples: 19347040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:36,869][16446] Avg episode reward: [(0, '5473.588')]
[2022-07-07 04:40:41,871][16446] Fps is (10 sec: 1637.9, 60 sec: 1638.3, 300 sec: 1652.3). Total num frames: 9682944. Throughput: 0: 3276.6. Samples: 19365888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:41,871][16446] Avg episode reward: [(0, '5538.036')]
[2022-07-07 04:40:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9691136. Throughput: 0: 3273.1. Samples: 19376384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:46,869][16446] Avg episode reward: [(0, '5504.557')]
[2022-07-07 04:40:51,871][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.3, 300 sec: 1652.3). Total num frames: 9699328. Throughput: 0: 3315.0. Samples: 19396536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:51,871][16446] Avg episode reward: [(0, '5507.500')]
[2022-07-07 04:40:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9707520. Throughput: 0: 3316.8. Samples: 19416832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:40:56,869][16446] Avg episode reward: [(0, '5543.486')]
[2022-07-07 04:41:01,868][16446] Fps is (10 sec: 1638.8, 60 sec: 1638.5, 300 sec: 1666.2). Total num frames: 9715712. Throughput: 0: 3349.3. Samples: 19427728. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:41:01,869][16446] Avg episode reward: [(0, '5506.538')]
[2022-07-07 04:41:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9723904. Throughput: 0: 3307.6. Samples: 19446192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:41:06,871][16446] Avg episode reward: [(0, '5591.915')]
[2022-07-07 04:41:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1652.3). Total num frames: 9732096. Throughput: 0: 3327.1. Samples: 19466456. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:41:11,869][16446] Avg episode reward: [(0, '5602.612')]
[2022-07-07 04:41:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1666.2). Total num frames: 9740288. Throughput: 0: 3299.9. Samples: 19475544. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:41:16,869][16446] Avg episode reward: [(0, '5581.643')]
[2022-07-07 04:41:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9748480. Throughput: 0: 3306.8. Samples: 19495848. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0)
[2022-07-07 04:41:21,868][16446] Avg episode reward: [(0, '5628.957')]
[2022-07-07 04:41:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9756672. Throughput: 0: 3320.6. Samples: 19515304. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:41:26,869][16446] Avg episode reward: [(0, '5658.331')]
[2022-07-07 04:41:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9764864. Throughput: 0: 3351.6. Samples: 19527208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:41:31,868][16446] Avg episode reward: [(0, '5662.000')]
[2022-07-07 04:41:36,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9773056. Throughput: 0: 3319.9. Samples: 19545928. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:41:36,870][16446] Avg episode reward: [(0, '5565.890')]
[2022-07-07 04:41:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1652.3). Total num frames: 9781248. Throughput: 0: 3296.5. Samples: 19565176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:41:41,869][16446] Avg episode reward: [(0, '5563.133')]
[2022-07-07 04:41:46,870][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.3, 300 sec: 1652.3). Total num frames: 9789440. Throughput: 0: 3277.4. Samples: 19575216. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:41:46,872][16446] Avg episode reward: [(0, '5549.231')]
[2022-07-07 04:41:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1652.3). Total num frames: 9797632. Throughput: 0: 3308.6. Samples: 19595080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0)
[2022-07-07 04:41:51,870][16446] Avg episode reward: [(0, '5440.666')]
[2022-07-07 04:41:56,871][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.3, 300 sec: 1652.3). Total num frames: 9805824. Throughput: 0: 3272.7. Samples: 19613736. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:41:56,873][16446] Avg episode reward: [(0, '5445.577')]
[2022-07-07 04:42:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9814016. Throughput: 0: 3292.8. Samples: 19623720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:42:01,869][16446] Avg episode reward: [(0, '5429.780')]
[2022-07-07 04:42:06,868][16446] Fps is (10 sec: 1638.9, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9822208. Throughput: 0: 3266.3. Samples: 19642832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:42:06,868][16446] Avg episode reward: [(0, '5417.767')]
[2022-07-07 04:42:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9830400. Throughput: 0: 3233.6. Samples: 19660816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:42:11,869][16446] Avg episode reward: [(0, '5447.708')]
[2022-07-07 04:42:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9838592. Throughput: 0: 3208.0. Samples: 19671568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:42:16,868][16446] Avg episode reward: [(0, '5436.676')]
[2022-07-07 04:42:21,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9846784. Throughput: 0: 3237.8. Samples: 19691624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:42:21,869][16446] Avg episode reward: [(0, '5443.756')]
[2022-07-07 04:42:26,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9854976. Throughput: 0: 3217.2. Samples: 19709952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:42:26,871][16446] Avg episode reward: [(0, '5437.500')]
[2022-07-07 04:42:31,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9863168. Throughput: 0: 3222.4. Samples: 19720216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:42:31,871][16446] Avg episode reward: [(0, '5523.195')]
[2022-07-07 04:42:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9871360. Throughput: 0: 3239.1. Samples: 19740840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:42:36,869][16446] Avg episode reward: [(0, '5443.499')]
[2022-07-07 04:42:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9879552. Throughput: 0: 3283.8. Samples: 19761496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:42:41,869][16446] Avg episode reward: [(0, '5432.938')]
[2022-07-07 04:42:46,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9887744. Throughput: 0: 3315.5. Samples: 19772920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:42:46,869][16446] Avg episode reward: [(0, '5458.498')]
[2022-07-07 04:42:51,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9895936. Throughput: 0: 3314.8. Samples: 19792000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:42:51,868][16446] Avg episode reward: [(0, '5413.371')]
[2022-07-07 04:42:56,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.5, 300 sec: 1652.3). Total num frames: 9904128. Throughput: 0: 3355.0. Samples: 19811792. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:42:56,868][16446] Avg episode reward: [(0, '5410.600')]
[2022-07-07 04:43:01,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9912320. Throughput: 0: 3335.1. Samples: 19821648. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:43:01,869][16446] Avg episode reward: [(0, '5351.663')]
[2022-07-07 04:43:06,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9920512. Throughput: 0: 3315.7. Samples: 19840832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:43:06,868][16446] Avg episode reward: [(0, '5293.020')]
[2022-07-07 04:43:11,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9928704. Throughput: 0: 3352.9. Samples: 19860832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:43:11,869][16446] Avg episode reward: [(0, '5256.135')]
[2022-07-07 04:43:16,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9936896. Throughput: 0: 3352.0. Samples: 19871056. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0)
[2022-07-07 04:43:16,869][16446] Avg episode reward: [(0, '5244.714')]
[2022-07-07 04:43:21,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 9945088. Throughput: 0: 3318.4. Samples: 19890168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:43:21,869][16446] Avg episode reward: [(0, '5260.274')]
[2022-07-07 04:43:26,868][16446] Fps is (10 sec: 1638.3, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 9953280. Throughput: 0: 3324.6. Samples: 19911104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:43:26,869][16446] Avg episode reward: [(0, '5191.545')]
[2022-07-07 04:43:31,868][16446] Fps is (10 sec: 1638.5, 60 sec: 1638.4, 300 sec: 1652.3). Total num frames: 9961472. Throughput: 0: 3264.7. Samples: 19919832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:43:31,869][16446] Avg episode reward: [(0, '5313.308')]
[2022-07-07 04:43:36,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 9969664. Throughput: 0: 3302.8. Samples: 19940624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:43:36,869][16446] Avg episode reward: [(0, '5305.208')]
[2022-07-07 04:43:41,868][16446] Fps is (10 sec: 1638.4, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 9977856. Throughput: 0: 3316.1. Samples: 19961016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:43:41,869][16446] Avg episode reward: [(0, '5310.902')]
[2022-07-07 04:43:46,869][16446] Fps is (10 sec: 1638.2, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 9986048. Throughput: 0: 3329.5. Samples: 19971480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:43:46,870][16446] Avg episode reward: [(0, '5328.806')]
[2022-07-07 04:43:51,868][16446] Fps is (10 sec: 2048.0, 60 sec: 1706.7, 300 sec: 1652.3). Total num frames: 9998336. Throughput: 0: 3342.6. Samples: 19991248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0)
[2022-07-07 04:43:51,869][16446] Avg episode reward: [(0, '5383.685')]
[2022-07-07 04:43:54,243][16446] Component RolloutWorker_w3 stopped!
[2022-07-07 04:43:54,244][16446] Waiting for ['Batcher_0', 'Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w1', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop...
[2022-07-07 04:43:54,244][16446] Component RolloutWorker_w1 stopped!
[2022-07-07 04:43:54,245][16446] Waiting for ['Batcher_0', 'Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop...
[2022-07-07 04:43:54,246][16446] Component RolloutWorker_w5 stopped!
[2022-07-07 04:43:54,251][16446] Waiting for ['Batcher_0', 'Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop...
[2022-07-07 04:43:54,252][16446] Component RolloutWorker_w7 stopped!
[2022-07-07 04:43:54,252][16446] Waiting for ['Batcher_0', 'Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w6'] to stop...
[2022-07-07 04:43:54,253][16446] Component RolloutWorker_w0 stopped!
[2022-07-07 04:43:54,253][16446] Waiting for ['Batcher_0', 'Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w6'] to stop...
[2022-07-07 04:43:54,253][16446] Component RolloutWorker_w4 stopped!
[2022-07-07 04:43:54,253][16446] Waiting for ['Batcher_0', 'Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w2', 'RolloutWorker_w6'] to stop...
[2022-07-07 04:43:54,254][16446] Component Batcher_0 stopped!
[2022-07-07 04:43:54,254][16446] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w2', 'RolloutWorker_w6'] to stop...
[2022-07-07 04:43:54,254][16446] Component RolloutWorker_w2 stopped!
[2022-07-07 04:43:54,254][16446] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w6'] to stop...
[2022-07-07 04:43:54,255][16446] Component RolloutWorker_w6 stopped!
[2022-07-07 04:43:54,255][16446] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0'] to stop...
[2022-07-07 04:43:54,261][16446] Component Learner_p0 stopped!
[2022-07-07 04:43:54,261][16446] Waiting for ['InferenceWorker_p0-w0'] to stop...
[2022-07-07 04:43:54,309][16446] Component InferenceWorker_p0-w0 stopped!
[2022-07-07 04:43:54,309][16446] Waiting for process learner_proc0 to stop...
[2022-07-07 04:43:54,650][16446] Waiting for process inference_proc0-0 to stop...
[2022-07-07 04:43:54,888][16446] Waiting for process rollout_proc0 to stop...
[2022-07-07 04:43:55,053][16446] Waiting for process rollout_proc1 to stop...
[2022-07-07 04:43:55,101][16446] Waiting for process rollout_proc2 to stop...
[2022-07-07 04:43:55,115][16446] Waiting for process rollout_proc3 to stop...
[2022-07-07 04:43:55,115][16446] Waiting for process rollout_proc4 to stop...
[2022-07-07 04:43:55,152][16446] Waiting for process rollout_proc5 to stop...
[2022-07-07 04:43:55,324][16446] Waiting for process rollout_proc6 to stop...
[2022-07-07 04:43:55,325][16446] Waiting for process rollout_proc7 to stop...
[2022-07-07 04:43:55,389][16446] Batcher 0 profile tree view:
batching: 6.5378, releasing_batches: 3.0191
[2022-07-07 04:43:55,390][16446] InferenceWorker_p0-w0 profile tree view:
wait_policy: 0.0051
  wait_policy_total: 3583.3863
update_model: 28.0185
  weight_update: 0.0008
one_step: 0.0023
  handle_policy_step: 2243.3492
    deserialize: 60.5745, stack: 13.7603, obs_to_device: 296.1324, norm: 257.9425, forward: 1069.5642, to_cpu: 178.3862, save_outputs: 95.5771, send_messages: 105.3958
[2022-07-07 04:43:55,391][16446] Learner 0 profile tree view:
prepare_batch: 23.5240
train: 173.1644
  prepare_train: 0.2018, epoch_init: 0.0648, minibatch_init: 1.6423, forward_head: 4.7597, bptt_initial: 0.2262, bptt: 0.2783, tail: 16.0435, losses: 34.5042, kl_divergence: 2.6077, after_optimizer: 2.3289
  update: 100.3963
    clip: 15.1724
[2022-07-07 04:43:55,392][16446] RolloutWorker_w0 profile tree view:
wait_for_trajectories: 0.8006, prepare_next_step: 63.2335, env_step: 2824.2539, overhead: 287.4303, complete_rollouts: 15.0600, enqueue_policy_requests: 561.4163
save_policy_outputs: 242.5280
  split_output_tensors: 115.8190
[2022-07-07 04:43:55,392][16446] RolloutWorker_w7 profile tree view:
wait_for_trajectories: 0.8117, prepare_next_step: 62.5612, env_step: 2783.9250, overhead: 287.1404, complete_rollouts: 24.0098, enqueue_policy_requests: 541.1336
save_policy_outputs: 238.7495
  split_output_tensors: 113.8338
[2022-07-07 04:43:55,393][16446] Loop Runner_EvtLoop terminating...
[2022-07-07 04:43:55,394][16446] Runner profile tree view:
main_loop: 6056.1859
[2022-07-07 04:43:55,394][16446] Collected {0: 10002432}, FPS: 1650.9